Mercurial > emacs
annotate src/coding.c @ 91240:b2febf77e71c
(Ffont_get): Fix arguments to Fassoc.
| author | Kenichi Handa <handa@m17n.org> |
|---|---|
| date | Tue, 18 Dec 2007 02:26:27 +0000 |
| parents | ff87badce376 |
| children | 606f2d163a64 |
| rev | line source |
|---|---|
| 88936 | 1 /* Coding system handler (conversion, detection, etc). |
|
68651
3bd95f4f2941
Update years in copyright notice; nfc.
Thien-Thi Nguyen <ttn@gnuvola.org>
parents:
68567
diff
changeset
|
2 Copyright (C) 2001, 2002, 2003, 2004, 2005, |
| 75348 | 3 2006, 2007 Free Software Foundation, Inc. |
|
74605
6ee41fdd69ff
Update AIST copyright years.
Kenichi Handa <handa@m17n.org>
parents:
73995
diff
changeset
|
4 Copyright (C) 1995, 1996, 1997, 1998, 1999, 2000, 2001, 2002, 2003, 2004, |
| 75348 | 5 2005, 2006, 2007 |
| 67658 | 6 National Institute of Advanced Industrial Science and Technology (AIST) |
| 7 Registration Number H14PRO021 | |
| 89483 | 8 Copyright (C) 2003 |
| 88365 | 9 National Institute of Advanced Industrial Science and Technology (AIST) |
| 10 Registration Number H13PRO009 | |
| 17052 | 11 |
| 17071 | 12 This file is part of GNU Emacs. |
| 13 | |
| 14 GNU Emacs is free software; you can redistribute it and/or modify | |
| 15 it under the terms of the GNU General Public License as published by | |
|
78313
2b9404c2f01f
Remove license from trivial file.
Glenn Morris <rgm@gnu.org>
parents:
78152
diff
changeset
|
16 the Free Software Foundation; either version 3, or (at your option) |
| 17071 | 17 any later version. |
| 18 | |
| 19 GNU Emacs is distributed in the hope that it will be useful, | |
| 20 but WITHOUT ANY WARRANTY; without even the implied warranty of | |
| 21 MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the | |
| 22 GNU General Public License for more details. | |
| 23 | |
| 24 You should have received a copy of the GNU General Public License | |
| 25 along with GNU Emacs; see the file COPYING. If not, write to | |
| 64084 | 26 the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, |
| 27 Boston, MA 02110-1301, USA. */ | |
| 17052 | 28 |
| 29 /*** TABLE OF CONTENTS *** | |
| 30 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
31 0. General comments |
| 17052 | 32 1. Preamble |
| 88365 | 33 2. Emacs' internal format (emacs-utf-8) handlers |
| 34 3. UTF-8 handlers | |
| 35 4. UTF-16 handlers | |
| 36 5. Charset-base coding systems handlers | |
| 37 6. emacs-mule (old Emacs' internal format) handlers | |
| 38 7. ISO2022 handlers | |
| 39 8. Shift-JIS and BIG5 handlers | |
| 40 9. CCL handlers | |
| 41 10. C library functions | |
| 42 11. Emacs Lisp library functions | |
| 43 12. Postamble | |
| 17052 | 44 |
| 45 */ | |
| 46 | |
| 88365 | 47 /*** 0. General comments *** |
| 48 | |
| 49 | |
| 50 CODING SYSTEM | |
| 51 | |
| 88485 | 52 A coding system is an object for an encoding mechanism that contains |
| 53 information about how to convert byte sequences to character | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
54 sequences and vice versa. When we say "decode", it means converting |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
55 a byte sequence of a specific coding system into a character |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
56 sequence that is represented by Emacs' internal coding system |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
57 `emacs-utf-8', and when we say "encode", it means converting a |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
58 character sequence of emacs-utf-8 to a byte sequence of a specific |
|
17835
f36ffb6f1208
Name change through the code:
Kenichi Handa <handa@m17n.org>
parents:
17725
diff
changeset
|
59 coding system. |
|
f36ffb6f1208
Name change through the code:
Kenichi Handa <handa@m17n.org>
parents:
17725
diff
changeset
|
60 |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
61 In Emacs Lisp, a coding system is represented by a Lisp symbol. In |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
62 C level, a coding system is represented by a vector of attributes |
| 88485 | 63 stored in the hash table Vcharset_hash_table. The conversion from |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
64 coding system symbol to attributes vector is done by looking up |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
65 Vcharset_hash_table by the symbol. |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
66 |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
67 Coding systems are classified into the following types depending on |
| 88485 | 68 the encoding mechanism. Here's a brief description of the types. |
| 88365 | 69 |
| 70 o UTF-8 | |
| 71 | |
| 72 o UTF-16 | |
| 73 | |
| 74 o Charset-base coding system | |
| 75 | |
| 76 A coding system defined by one or more (coded) character sets. | |
| 88485 | 77 Decoding and encoding are done by a code converter defined for each |
| 88365 | 78 character set. |
| 79 | |
| 88485 | 80 o Old Emacs internal format (emacs-mule) |
| 81 | |
| 82 The coding system adopted by old versions of Emacs (20 and 21). | |
| 88365 | 83 |
| 84 o ISO2022-base coding system | |
| 17052 | 85 |
| 86 The most famous coding system for multiple character sets. X's | |
| 88365 | 87 Compound Text, various EUCs (Extended Unix Code), and coding systems |
| 88 used in the Internet communication such as ISO-2022-JP are all | |
| 89 variants of ISO2022. | |
| 90 | |
| 91 o SJIS (or Shift-JIS or MS-Kanji-Code) | |
|
42104
d69c2368e549
(DECODE_COMPOSITION_END): Fixed a typo in the last
Sam Steingold <sds@gnu.org>
parents:
42103
diff
changeset
|
92 |
| 17052 | 93 A coding system to encode character sets: ASCII, JISX0201, and |
| 94 JISX0208. Widely used for PC's in Japan. Details are described in | |
| 88365 | 95 section 8. |
| 96 | |
| 97 o BIG5 | |
| 98 | |
| 99 A coding system to encode character sets: ASCII and Big5. Widely | |
| 35053 | 100 used for Chinese (mainly in Taiwan and Hong Kong). Details are |
| 88365 | 101 described in section 8. In this file, when we write "big5" (all |
| 102 lowercase), we mean the coding system, and when we write "Big5" | |
| 103 (capitalized), we mean the character set. | |
| 104 | |
| 105 o CCL | |
| 106 | |
| 88485 | 107 If a user wants to decode/encode text encoded in a coding system |
| 88365 | 108 not listed above, he can supply a decoder and an encoder for it in |
| 109 CCL (Code Conversion Language) programs. Emacs executes the CCL | |
| 110 program while decoding/encoding. | |
| 111 | |
| 112 o Raw-text | |
| 113 | |
| 88771 | 114 A coding system for text containing raw eight-bit data. Emacs |
| 88485 | 115 treats each byte of source text as a character (except for |
| 88365 | 116 end-of-line conversion). |
| 117 | |
| 118 o No-conversion | |
| 119 | |
| 120 Like raw text, but don't do end-of-line conversion. | |
| 121 | |
| 122 | |
| 123 END-OF-LINE FORMAT | |
| 124 | |
| 88485 | 125 How text end-of-line is encoded depends on operating system. For |
| 88365 | 126 instance, Unix's format is just one byte of LF (line-feed) code, |
| 18766 | 127 whereas DOS's format is two-byte sequence of `carriage-return' and |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
128 `line-feed' codes. MacOS's format is usually one byte of |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
129 `carriage-return'. |
| 17052 | 130 |
| 35053 | 131 Since text character encoding and end-of-line encoding are |
| 88365 | 132 independent, any coding system described above can take any format |
| 133 of end-of-line (except for no-conversion). | |
| 17052 | 134 |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
135 STRUCT CODING_SYSTEM |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
136 |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
137 Before using a coding system for code conversion (i.e. decoding and |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
138 encoding), we setup a structure of type `struct coding_system'. |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
139 This structure keeps various information about a specific code |
| 88485 | 140 conversion (e.g. the location of source and destination data). |
| 17052 | 141 |
| 142 */ | |
| 143 | |
| 88365 | 144 /* COMMON MACROS */ |
| 145 | |
| 146 | |
| 17052 | 147 /*** GENERAL NOTES on `detect_coding_XXX ()' functions *** |
| 148 | |
| 88365 | 149 These functions check if a byte sequence specified as a source in |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
150 CODING conforms to the format of XXX, and update the members of |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
151 DETECT_INFO. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
152 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
153 Return 1 if the byte sequence conforms to XXX, otherwise return 0. |
| 88365 | 154 |
| 155 Below is the template of these functions. */ | |
| 156 | |
| 17052 | 157 #if 0 |
| 88365 | 158 static int |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
159 detect_coding_XXX (coding, detect_info) |
| 88365 | 160 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
161 struct coding_detection_info *detect_info; |
| 17052 | 162 { |
|
90070
95879cc1ed20
Revision: miles@gnu.org--gnu-2004/emacs--unicode--0--patch-81
Miles Bader <miles@gnu.org>
diff
changeset
|
163 const unsigned char *src = coding->source; |
|
95879cc1ed20
Revision: miles@gnu.org--gnu-2004/emacs--unicode--0--patch-81
Miles Bader <miles@gnu.org>
diff
changeset
|
164 const unsigned char *src_end = coding->source + coding->src_bytes; |
| 88365 | 165 int multibytep = coding->src_multibyte; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
166 int consumed_chars = 0; |
| 88365 | 167 int found = 0; |
| 168 ...; | |
| 169 | |
| 170 while (1) | |
| 171 { | |
| 172 /* Get one byte from the source. If the souce is exausted, jump | |
| 173 to no_more_source:. */ | |
| 174 ONE_MORE_BYTE (c); | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
175 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
176 if (! __C_conforms_to_XXX___ (c)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
177 break; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
178 if (! __C_strongly_suggests_XXX__ (c)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
179 found = CATEGORY_MASK_XXX; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
180 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
181 /* The byte sequence is invalid for XXX. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
182 detect_info->rejected |= CATEGORY_MASK_XXX; |
| 88365 | 183 return 0; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
184 |
| 88365 | 185 no_more_source: |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
186 /* The source exausted successfully. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
187 detect_info->found |= found; |
| 88365 | 188 return 1; |
| 17052 | 189 } |
| 190 #endif | |
| 191 | |
| 192 /*** GENERAL NOTES on `decode_coding_XXX ()' functions *** | |
| 193 | |
| 88365 | 194 These functions decode a byte sequence specified as a source by |
| 195 CODING. The resulting multibyte text goes to a place pointed to by | |
| 196 CODING->charbuf, the length of which should not exceed | |
| 197 CODING->charbuf_size; | |
| 198 | |
| 199 These functions set the information of original and decoded texts in | |
| 200 CODING->consumed, CODING->consumed_char, and CODING->charbuf_used. | |
| 201 They also set CODING->result to one of CODING_RESULT_XXX indicating | |
| 202 how the decoding is finished. | |
| 203 | |
| 204 Below is the template of these functions. */ | |
| 205 | |
| 17052 | 206 #if 0 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
207 static void |
| 88365 | 208 decode_coding_XXXX (coding) |
| 17052 | 209 struct coding_system *coding; |
| 210 { | |
|
90070
95879cc1ed20
Revision: miles@gnu.org--gnu-2004/emacs--unicode--0--patch-81
Miles Bader <miles@gnu.org>
diff
changeset
|
211 const unsigned char *src = coding->source + coding->consumed; |
|
95879cc1ed20
Revision: miles@gnu.org--gnu-2004/emacs--unicode--0--patch-81
Miles Bader <miles@gnu.org>
diff
changeset
|
212 const unsigned char *src_end = coding->source + coding->src_bytes; |
| 88365 | 213 /* SRC_BASE remembers the start position in source in each loop. |
| 214 The loop will be exited when there's not enough source code, or | |
| 215 when there's no room in CHARBUF for a decoded character. */ | |
|
90070
95879cc1ed20
Revision: miles@gnu.org--gnu-2004/emacs--unicode--0--patch-81
Miles Bader <miles@gnu.org>
diff
changeset
|
216 const unsigned char *src_base; |
| 88365 | 217 /* A buffer to produce decoded characters. */ |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
218 int *charbuf = coding->charbuf + coding->charbuf_used; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
219 int *charbuf_end = coding->charbuf + coding->charbuf_size; |
| 88365 | 220 int multibytep = coding->src_multibyte; |
| 221 | |
| 222 while (1) | |
| 223 { | |
| 224 src_base = src; | |
| 225 if (charbuf < charbuf_end) | |
| 226 /* No more room to produce a decoded character. */ | |
| 227 break; | |
| 228 ONE_MORE_BYTE (c); | |
| 229 /* Decode it. */ | |
| 230 } | |
| 231 | |
| 232 no_more_source: | |
| 233 if (src_base < src_end | |
| 234 && coding->mode & CODING_MODE_LAST_BLOCK) | |
| 235 /* If the source ends by partial bytes to construct a character, | |
| 236 treat them as eight-bit raw data. */ | |
| 237 while (src_base < src_end && charbuf < charbuf_end) | |
| 238 *charbuf++ = *src_base++; | |
| 239 /* Remember how many bytes and characters we consumed. If the | |
| 240 source is multibyte, the bytes and chars are not identical. */ | |
| 241 coding->consumed = coding->consumed_char = src_base - coding->source; | |
| 242 /* Remember how many characters we produced. */ | |
| 243 coding->charbuf_used = charbuf - coding->charbuf; | |
| 17052 | 244 } |
| 245 #endif | |
| 246 | |
| 247 /*** GENERAL NOTES on `encode_coding_XXX ()' functions *** | |
| 248 | |
| 88365 | 249 These functions encode SRC_BYTES length text at SOURCE of Emacs' |
| 250 internal multibyte format by CODING. The resulting byte sequence | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
251 goes to a place pointed to by DESTINATION, the length of which |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
252 should not exceed DST_BYTES. |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
253 |
| 88365 | 254 These functions set the information of original and encoded texts in |
| 255 the members produced, produced_char, consumed, and consumed_char of | |
| 256 the structure *CODING. They also set the member result to one of | |
| 257 CODING_RESULT_XXX indicating how the encoding finished. | |
| 258 | |
| 259 DST_BYTES zero means that source area and destination area are | |
| 260 overlapped, which means that we can produce a encoded text until it | |
| 261 reaches at the head of not-yet-encoded source text. | |
| 262 | |
| 263 Below is a template of these functions. */ | |
| 17052 | 264 #if 0 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
265 static void |
| 88365 | 266 encode_coding_XXX (coding) |
| 17052 | 267 struct coding_system *coding; |
| 268 { | |
| 88365 | 269 int multibytep = coding->dst_multibyte; |
| 270 int *charbuf = coding->charbuf; | |
| 271 int *charbuf_end = charbuf->charbuf + coding->charbuf_used; | |
| 272 unsigned char *dst = coding->destination + coding->produced; | |
| 273 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 274 unsigned char *adjusted_dst_end = dst_end - _MAX_BYTES_PRODUCED_IN_LOOP_; | |
| 275 int produced_chars = 0; | |
| 276 | |
| 277 for (; charbuf < charbuf_end && dst < adjusted_dst_end; charbuf++) | |
| 278 { | |
| 279 int c = *charbuf; | |
| 280 /* Encode C into DST, and increment DST. */ | |
| 281 } | |
| 282 label_no_more_destination: | |
| 283 /* How many chars and bytes we produced. */ | |
| 284 coding->produced_char += produced_chars; | |
| 285 coding->produced = dst - coding->destination; | |
| 17052 | 286 } |
| 287 #endif | |
| 288 | |
| 289 | |
| 290 /*** 1. Preamble ***/ | |
| 291 | |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
292 #include <config.h> |
| 17052 | 293 #include <stdio.h> |
| 294 | |
| 295 #include "lisp.h" | |
| 296 #include "buffer.h" | |
| 88365 | 297 #include "character.h" |
| 17052 | 298 #include "charset.h" |
| 88365 | 299 #include "ccl.h" |
| 26847 | 300 #include "composite.h" |
| 17052 | 301 #include "coding.h" |
| 302 #include "window.h" | |
|
83127
5182815e0ee1
Make terminal_coding and keyboard_coding display-local.
Karoly Lorentey <lorentey@elte.hu>
parents:
54320
diff
changeset
|
303 #include "frame.h" |
|
5182815e0ee1
Make terminal_coding and keyboard_coding display-local.
Karoly Lorentey <lorentey@elte.hu>
parents:
54320
diff
changeset
|
304 #include "termhooks.h" |
| 17052 | 305 |
| 88365 | 306 Lisp_Object Vcoding_system_hash_table; |
| 307 | |
| 308 Lisp_Object Qcoding_system, Qcoding_aliases, Qeol_type; | |
|
88646
d3b1f30e2267
(Qmac): Remove (duplicated) definition.
Dave Love <fx@gnu.org>
parents:
88645
diff
changeset
|
309 Lisp_Object Qunix, Qdos; |
|
d3b1f30e2267
(Qmac): Remove (duplicated) definition.
Dave Love <fx@gnu.org>
parents:
88645
diff
changeset
|
310 extern Lisp_Object Qmac; /* frame.c */ |
| 17052 | 311 Lisp_Object Qbuffer_file_coding_system; |
| 312 Lisp_Object Qpost_read_conversion, Qpre_write_conversion; | |
| 88365 | 313 Lisp_Object Qdefault_char; |
|
19612
783efd6c7c1e
(Qno_conversion, Qundecided): New variables.
Kenichi Handa <handa@m17n.org>
parents:
19546
diff
changeset
|
314 Lisp_Object Qno_conversion, Qundecided; |
| 88365 | 315 Lisp_Object Qcharset, Qiso_2022, Qutf_8, Qutf_16, Qshift_jis, Qbig5; |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
316 Lisp_Object Qbig, Qlittle; |
|
19750
95e4e1cba6ac
(Qcoding_system_history): New variable.
Richard M. Stallman <rms@gnu.org>
parents:
19747
diff
changeset
|
317 Lisp_Object Qcoding_system_history; |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
318 Lisp_Object Qvalid_codes; |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
319 Lisp_Object QCcategory, QCmnemonic, QCdefalut_char; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
320 Lisp_Object QCdecode_translation_table, QCencode_translation_table; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
321 Lisp_Object QCpost_read_conversion, QCpre_write_conversion; |
|
90214
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
322 Lisp_Object QCascii_compatible_p; |
| 17052 | 323 |
| 324 extern Lisp_Object Qinsert_file_contents, Qwrite_region; | |
|
64251
3de1b955c31a
* coding.c (Qprocess_argument):
Kim F. Storm <storm@cua.dk>
parents:
64084
diff
changeset
|
325 Lisp_Object Qcall_process, Qcall_process_region; |
| 17052 | 326 Lisp_Object Qstart_process, Qopen_network_stream; |
| 327 Lisp_Object Qtarget_idx; | |
| 328 | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
329 Lisp_Object Qinsufficient_source, Qinconsistent_eol, Qinvalid_source; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
330 Lisp_Object Qinterrupted, Qinsufficient_memory; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
331 |
|
85332
bb808ca35bd9
(Qcompletion_ignore_case): New external Lisp_Object.
Glenn Morris <rgm@gnu.org>
parents:
85330
diff
changeset
|
332 extern Lisp_Object Qcompletion_ignore_case; |
|
bb808ca35bd9
(Qcompletion_ignore_case): New external Lisp_Object.
Glenn Morris <rgm@gnu.org>
parents:
85330
diff
changeset
|
333 |
|
52794
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
334 /* If a symbol has this property, evaluate the value to define the |
|
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
335 symbol as a coding system. */ |
|
90272
f1df126ec7de
Sync to HEAD for handling autoload-coding-system.
Kenichi Handa <handa@m17n.org>
parents:
90263
diff
changeset
|
336 static Lisp_Object Qcoding_system_define_form; |
|
f1df126ec7de
Sync to HEAD for handling autoload-coding-system.
Kenichi Handa <handa@m17n.org>
parents:
90263
diff
changeset
|
337 |
| 89483 | 338 int coding_system_require_warning; |
|
52794
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
339 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
340 Lisp_Object Vselect_safe_coding_system_function; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
341 |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
342 /* Mnemonic string for each format of end-of-line. */ |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
343 Lisp_Object eol_mnemonic_unix, eol_mnemonic_dos, eol_mnemonic_mac; |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
344 /* Mnemonic string to indicate format of end-of-line is not yet |
| 17052 | 345 decided. */ |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
346 Lisp_Object eol_mnemonic_undecided; |
| 17052 | 347 |
|
90394
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
348 /* Format of end-of-line decided by system. This is Qunix on |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
349 Unix and Mac, Qdos on DOS/Windows. |
|
70520
b6740a317343
(setup_coding_system): For invalid coding-system, set
Kenichi Handa <handa@m17n.org>
parents:
69995
diff
changeset
|
350 This has an effect only for external encoding (i.e. for output to |
|
b6740a317343
(setup_coding_system): For invalid coding-system, set
Kenichi Handa <handa@m17n.org>
parents:
69995
diff
changeset
|
351 file and process), not for in-buffer or Lisp string encoding. */ |
|
90394
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
352 static Lisp_Object system_eol_type; |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
353 |
| 17052 | 354 #ifdef emacs |
| 355 | |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
356 Lisp_Object Vcoding_system_list, Vcoding_system_alist; |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
357 |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
358 Lisp_Object Qcoding_system_p, Qcoding_system_error; |
| 17052 | 359 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
360 /* Coding system emacs-mule and raw-text are for converting only |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
361 end-of-line format. */ |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
362 Lisp_Object Qemacs_mule, Qraw_text; |
| 89483 | 363 Lisp_Object Qutf_8_emacs; |
| 51406 | 364 |
| 17052 | 365 /* Coding-systems are handed between Emacs Lisp programs and C internal |
| 366 routines by the following three variables. */ | |
| 367 /* Coding-system for reading files and receiving data from process. */ | |
| 368 Lisp_Object Vcoding_system_for_read; | |
| 369 /* Coding-system for writing files and sending data to process. */ | |
| 370 Lisp_Object Vcoding_system_for_write; | |
| 371 /* Coding-system actually used in the latest I/O. */ | |
| 372 Lisp_Object Vlast_coding_system_used; | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
373 /* Set to non-nil when an error is detected while code conversion. */ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
374 Lisp_Object Vlast_code_conversion_error; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
375 /* A vector of length 256 which contains information about special |
| 22529 | 376 Latin codes (especially for dealing with Microsoft codes). */ |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
377 Lisp_Object Vlatin_extra_code_table; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
378 |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
379 /* Flag to inhibit code conversion of end-of-line format. */ |
|
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
380 int inhibit_eol_conversion; |
|
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
381 |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
382 /* Flag to inhibit ISO2022 escape sequence detection. */ |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
383 int inhibit_iso_escape_detection; |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
384 |
|
21574
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
385 /* Flag to make buffer-file-coding-system inherit from process-coding. */ |
|
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
386 int inherit_process_coding_system; |
|
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
387 |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
388 /* Coding system to be used to encode text for terminal display when |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
389 terminal coding system is nil. */ |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
390 struct coding_system safe_terminal_coding; |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
391 |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
392 Lisp_Object Vfile_coding_system_alist; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
393 Lisp_Object Vprocess_coding_system_alist; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
394 Lisp_Object Vnetwork_coding_system_alist; |
| 17052 | 395 |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
396 Lisp_Object Vlocale_coding_system; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
397 |
| 17052 | 398 #endif /* emacs */ |
| 399 | |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
400 /* Flag to tell if we look up translation table on character code |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
401 conversion. */ |
|
22119
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
402 Lisp_Object Venable_character_translation; |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
403 /* Standard translation table to look up on decoding (reading). */ |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
404 Lisp_Object Vstandard_translation_table_for_decode; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
405 /* Standard translation table to look up on encoding (writing). */ |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
406 Lisp_Object Vstandard_translation_table_for_encode; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
407 |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
408 Lisp_Object Qtranslation_table; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
409 Lisp_Object Qtranslation_table_id; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
410 Lisp_Object Qtranslation_table_for_decode; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
411 Lisp_Object Qtranslation_table_for_encode; |
| 17052 | 412 |
| 413 /* Alist of charsets vs revision number. */ | |
| 88365 | 414 static Lisp_Object Vcharset_revision_table; |
| 17052 | 415 |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
416 /* Default coding systems used for process I/O. */ |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
417 Lisp_Object Vdefault_process_coding_system; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
418 |
|
48182
9474e269efd1
Reformat some DEFUNs so that etags works.
Dave Love <fx@gnu.org>
parents:
48125
diff
changeset
|
419 /* Char table for translating Quail and self-inserting input. */ |
|
9474e269efd1
Reformat some DEFUNs so that etags works.
Dave Love <fx@gnu.org>
parents:
48125
diff
changeset
|
420 Lisp_Object Vtranslation_table_for_input; |
|
9474e269efd1
Reformat some DEFUNs so that etags works.
Dave Love <fx@gnu.org>
parents:
48125
diff
changeset
|
421 |
| 88365 | 422 /* Two special coding systems. */ |
| 423 Lisp_Object Vsjis_coding_system; | |
| 424 Lisp_Object Vbig5_coding_system; | |
| 425 | |
| 426 /* ISO2022 section */ | |
| 427 | |
| 428 #define CODING_ISO_INITIAL(coding, reg) \ | |
| 429 (XINT (AREF (AREF (CODING_ID_ATTRS ((coding)->id), \ | |
| 430 coding_attr_iso_initial), \ | |
| 431 reg))) | |
| 432 | |
| 433 | |
| 434 #define CODING_ISO_REQUEST(coding, charset_id) \ | |
| 435 ((charset_id <= (coding)->max_charset_id \ | |
| 436 ? (coding)->safe_charsets[charset_id] \ | |
| 437 : -1)) | |
| 438 | |
| 439 | |
| 440 #define CODING_ISO_FLAGS(coding) \ | |
| 441 ((coding)->spec.iso_2022.flags) | |
| 442 #define CODING_ISO_DESIGNATION(coding, reg) \ | |
| 443 ((coding)->spec.iso_2022.current_designation[reg]) | |
| 444 #define CODING_ISO_INVOCATION(coding, plane) \ | |
| 445 ((coding)->spec.iso_2022.current_invocation[plane]) | |
| 446 #define CODING_ISO_SINGLE_SHIFTING(coding) \ | |
| 447 ((coding)->spec.iso_2022.single_shifting) | |
| 448 #define CODING_ISO_BOL(coding) \ | |
| 449 ((coding)->spec.iso_2022.bol) | |
| 450 #define CODING_ISO_INVOKED_CHARSET(coding, plane) \ | |
| 451 CODING_ISO_DESIGNATION ((coding), CODING_ISO_INVOCATION ((coding), (plane))) | |
| 452 | |
| 453 /* Control characters of ISO2022. */ | |
| 454 /* code */ /* function */ | |
| 455 #define ISO_CODE_LF 0x0A /* line-feed */ | |
| 456 #define ISO_CODE_CR 0x0D /* carriage-return */ | |
| 457 #define ISO_CODE_SO 0x0E /* shift-out */ | |
| 458 #define ISO_CODE_SI 0x0F /* shift-in */ | |
| 459 #define ISO_CODE_SS2_7 0x19 /* single-shift-2 for 7-bit code */ | |
| 460 #define ISO_CODE_ESC 0x1B /* escape */ | |
| 461 #define ISO_CODE_SS2 0x8E /* single-shift-2 */ | |
| 462 #define ISO_CODE_SS3 0x8F /* single-shift-3 */ | |
| 463 #define ISO_CODE_CSI 0x9B /* control-sequence-introducer */ | |
| 464 | |
| 465 /* All code (1-byte) of ISO2022 is classified into one of the | |
| 466 followings. */ | |
| 467 enum iso_code_class_type | |
| 468 { | |
| 469 ISO_control_0, /* Control codes in the range | |
| 470 0x00..0x1F and 0x7F, except for the | |
| 471 following 5 codes. */ | |
| 472 ISO_shift_out, /* ISO_CODE_SO (0x0E) */ | |
| 473 ISO_shift_in, /* ISO_CODE_SI (0x0F) */ | |
| 474 ISO_single_shift_2_7, /* ISO_CODE_SS2_7 (0x19) */ | |
| 475 ISO_escape, /* ISO_CODE_SO (0x1B) */ | |
| 476 ISO_control_1, /* Control codes in the range | |
| 477 0x80..0x9F, except for the | |
| 478 following 3 codes. */ | |
| 479 ISO_single_shift_2, /* ISO_CODE_SS2 (0x8E) */ | |
| 480 ISO_single_shift_3, /* ISO_CODE_SS3 (0x8F) */ | |
| 481 ISO_control_sequence_introducer, /* ISO_CODE_CSI (0x9B) */ | |
| 482 ISO_0x20_or_0x7F, /* Codes of the values 0x20 or 0x7F. */ | |
| 483 ISO_graphic_plane_0, /* Graphic codes in the range 0x21..0x7E. */ | |
| 484 ISO_0xA0_or_0xFF, /* Codes of the values 0xA0 or 0xFF. */ | |
| 485 ISO_graphic_plane_1 /* Graphic codes in the range 0xA1..0xFE. */ | |
| 486 }; | |
| 487 | |
| 488 /** The macros CODING_ISO_FLAG_XXX defines a flag bit of the | |
| 489 `iso-flags' attribute of an iso2022 coding system. */ | |
| 490 | |
| 491 /* If set, produce long-form designation sequence (e.g. ESC $ ( A) | |
| 492 instead of the correct short-form sequence (e.g. ESC $ A). */ | |
| 493 #define CODING_ISO_FLAG_LONG_FORM 0x0001 | |
| 494 | |
| 495 /* If set, reset graphic planes and registers at end-of-line to the | |
| 496 initial state. */ | |
| 497 #define CODING_ISO_FLAG_RESET_AT_EOL 0x0002 | |
| 498 | |
| 499 /* If set, reset graphic planes and registers before any control | |
| 500 characters to the initial state. */ | |
| 501 #define CODING_ISO_FLAG_RESET_AT_CNTL 0x0004 | |
| 502 | |
| 503 /* If set, encode by 7-bit environment. */ | |
| 504 #define CODING_ISO_FLAG_SEVEN_BITS 0x0008 | |
| 505 | |
| 506 /* If set, use locking-shift function. */ | |
| 507 #define CODING_ISO_FLAG_LOCKING_SHIFT 0x0010 | |
| 508 | |
| 509 /* If set, use single-shift function. Overwrite | |
| 510 CODING_ISO_FLAG_LOCKING_SHIFT. */ | |
| 511 #define CODING_ISO_FLAG_SINGLE_SHIFT 0x0020 | |
| 512 | |
| 513 /* If set, use designation escape sequence. */ | |
| 514 #define CODING_ISO_FLAG_DESIGNATION 0x0040 | |
| 515 | |
| 516 /* If set, produce revision number sequence. */ | |
| 517 #define CODING_ISO_FLAG_REVISION 0x0080 | |
| 518 | |
| 519 /* If set, produce ISO6429's direction specifying sequence. */ | |
| 520 #define CODING_ISO_FLAG_DIRECTION 0x0100 | |
| 521 | |
| 522 /* If set, assume designation states are reset at beginning of line on | |
| 523 output. */ | |
| 524 #define CODING_ISO_FLAG_INIT_AT_BOL 0x0200 | |
| 525 | |
| 526 /* If set, designation sequence should be placed at beginning of line | |
| 527 on output. */ | |
| 528 #define CODING_ISO_FLAG_DESIGNATE_AT_BOL 0x0400 | |
| 529 | |
| 530 /* If set, do not encode unsafe charactes on output. */ | |
| 531 #define CODING_ISO_FLAG_SAFE 0x0800 | |
| 532 | |
| 533 /* If set, extra latin codes (128..159) are accepted as a valid code | |
| 534 on input. */ | |
| 535 #define CODING_ISO_FLAG_LATIN_EXTRA 0x1000 | |
| 536 | |
| 537 #define CODING_ISO_FLAG_COMPOSITION 0x2000 | |
| 538 | |
| 539 #define CODING_ISO_FLAG_EUC_TW_SHIFT 0x4000 | |
| 540 | |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
541 #define CODING_ISO_FLAG_USE_ROMAN 0x8000 |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
542 |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
543 #define CODING_ISO_FLAG_USE_OLDJIS 0x10000 |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
544 |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
545 #define CODING_ISO_FLAG_FULL_SUPPORT 0x100000 |
| 88365 | 546 |
| 547 /* A character to be produced on output if encoding of the original | |
| 548 character is prohibited by CODING_ISO_FLAG_SAFE. */ | |
| 549 #define CODING_INHIBIT_CHARACTER_SUBSTITUTION '?' | |
| 550 | |
| 551 | |
| 552 /* UTF-16 section */ | |
| 553 #define CODING_UTF_16_BOM(coding) \ | |
| 554 ((coding)->spec.utf_16.bom) | |
| 555 | |
| 556 #define CODING_UTF_16_ENDIAN(coding) \ | |
| 557 ((coding)->spec.utf_16.endian) | |
| 558 | |
| 559 #define CODING_UTF_16_SURROGATE(coding) \ | |
| 560 ((coding)->spec.utf_16.surrogate) | |
| 561 | |
| 562 | |
| 563 /* CCL section */ | |
| 564 #define CODING_CCL_DECODER(coding) \ | |
| 565 AREF (CODING_ID_ATTRS ((coding)->id), coding_attr_ccl_decoder) | |
| 566 #define CODING_CCL_ENCODER(coding) \ | |
| 567 AREF (CODING_ID_ATTRS ((coding)->id), coding_attr_ccl_encoder) | |
| 568 #define CODING_CCL_VALIDS(coding) \ | |
| 89483 | 569 (SDATA (AREF (CODING_ID_ATTRS ((coding)->id), coding_attr_ccl_valids))) |
| 88365 | 570 |
| 88771 | 571 /* Index for each coding category in `coding_categories' */ |
| 88365 | 572 |
| 573 enum coding_category | |
| 574 { | |
| 575 coding_category_iso_7, | |
| 576 coding_category_iso_7_tight, | |
| 577 coding_category_iso_8_1, | |
| 578 coding_category_iso_8_2, | |
| 579 coding_category_iso_7_else, | |
| 580 coding_category_iso_8_else, | |
| 581 coding_category_utf_8, | |
| 582 coding_category_utf_16_auto, | |
| 583 coding_category_utf_16_be, | |
| 584 coding_category_utf_16_le, | |
| 585 coding_category_utf_16_be_nosig, | |
| 586 coding_category_utf_16_le_nosig, | |
| 587 coding_category_charset, | |
| 588 coding_category_sjis, | |
| 589 coding_category_big5, | |
| 590 coding_category_ccl, | |
| 591 coding_category_emacs_mule, | |
| 592 /* All above are targets of code detection. */ | |
| 593 coding_category_raw_text, | |
| 594 coding_category_undecided, | |
| 595 coding_category_max | |
| 596 }; | |
| 597 | |
| 598 /* Definitions of flag bits used in detect_coding_XXXX. */ | |
| 599 #define CATEGORY_MASK_ISO_7 (1 << coding_category_iso_7) | |
| 600 #define CATEGORY_MASK_ISO_7_TIGHT (1 << coding_category_iso_7_tight) | |
| 601 #define CATEGORY_MASK_ISO_8_1 (1 << coding_category_iso_8_1) | |
| 602 #define CATEGORY_MASK_ISO_8_2 (1 << coding_category_iso_8_2) | |
| 603 #define CATEGORY_MASK_ISO_7_ELSE (1 << coding_category_iso_7_else) | |
| 604 #define CATEGORY_MASK_ISO_8_ELSE (1 << coding_category_iso_8_else) | |
| 605 #define CATEGORY_MASK_UTF_8 (1 << coding_category_utf_8) | |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
606 #define CATEGORY_MASK_UTF_16_AUTO (1 << coding_category_utf_16_auto) |
| 88365 | 607 #define CATEGORY_MASK_UTF_16_BE (1 << coding_category_utf_16_be) |
| 608 #define CATEGORY_MASK_UTF_16_LE (1 << coding_category_utf_16_le) | |
| 609 #define CATEGORY_MASK_UTF_16_BE_NOSIG (1 << coding_category_utf_16_be_nosig) | |
| 610 #define CATEGORY_MASK_UTF_16_LE_NOSIG (1 << coding_category_utf_16_le_nosig) | |
| 611 #define CATEGORY_MASK_CHARSET (1 << coding_category_charset) | |
| 612 #define CATEGORY_MASK_SJIS (1 << coding_category_sjis) | |
| 613 #define CATEGORY_MASK_BIG5 (1 << coding_category_big5) | |
| 614 #define CATEGORY_MASK_CCL (1 << coding_category_ccl) | |
| 615 #define CATEGORY_MASK_EMACS_MULE (1 << coding_category_emacs_mule) | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
616 #define CATEGORY_MASK_RAW_TEXT (1 << coding_category_raw_text) |
| 88365 | 617 |
| 618 /* This value is returned if detect_coding_mask () find nothing other | |
| 619 than ASCII characters. */ | |
| 620 #define CATEGORY_MASK_ANY \ | |
| 621 (CATEGORY_MASK_ISO_7 \ | |
| 622 | CATEGORY_MASK_ISO_7_TIGHT \ | |
| 623 | CATEGORY_MASK_ISO_8_1 \ | |
| 624 | CATEGORY_MASK_ISO_8_2 \ | |
| 625 | CATEGORY_MASK_ISO_7_ELSE \ | |
| 626 | CATEGORY_MASK_ISO_8_ELSE \ | |
| 627 | CATEGORY_MASK_UTF_8 \ | |
| 628 | CATEGORY_MASK_UTF_16_BE \ | |
| 629 | CATEGORY_MASK_UTF_16_LE \ | |
| 630 | CATEGORY_MASK_UTF_16_BE_NOSIG \ | |
| 631 | CATEGORY_MASK_UTF_16_LE_NOSIG \ | |
| 632 | CATEGORY_MASK_CHARSET \ | |
| 633 | CATEGORY_MASK_SJIS \ | |
| 634 | CATEGORY_MASK_BIG5 \ | |
| 635 | CATEGORY_MASK_CCL \ | |
| 636 | CATEGORY_MASK_EMACS_MULE) | |
| 637 | |
| 638 | |
| 639 #define CATEGORY_MASK_ISO_7BIT \ | |
| 640 (CATEGORY_MASK_ISO_7 | CATEGORY_MASK_ISO_7_TIGHT) | |
| 641 | |
| 642 #define CATEGORY_MASK_ISO_8BIT \ | |
| 643 (CATEGORY_MASK_ISO_8_1 | CATEGORY_MASK_ISO_8_2) | |
| 644 | |
| 645 #define CATEGORY_MASK_ISO_ELSE \ | |
| 646 (CATEGORY_MASK_ISO_7_ELSE | CATEGORY_MASK_ISO_8_ELSE) | |
| 647 | |
| 648 #define CATEGORY_MASK_ISO_ESCAPE \ | |
| 649 (CATEGORY_MASK_ISO_7 \ | |
| 650 | CATEGORY_MASK_ISO_7_TIGHT \ | |
| 651 | CATEGORY_MASK_ISO_7_ELSE \ | |
| 652 | CATEGORY_MASK_ISO_8_ELSE) | |
| 653 | |
| 654 #define CATEGORY_MASK_ISO \ | |
| 655 ( CATEGORY_MASK_ISO_7BIT \ | |
| 656 | CATEGORY_MASK_ISO_8BIT \ | |
| 657 | CATEGORY_MASK_ISO_ELSE) | |
| 658 | |
| 659 #define CATEGORY_MASK_UTF_16 \ | |
| 660 (CATEGORY_MASK_UTF_16_BE \ | |
| 661 | CATEGORY_MASK_UTF_16_LE \ | |
| 662 | CATEGORY_MASK_UTF_16_BE_NOSIG \ | |
| 663 | CATEGORY_MASK_UTF_16_LE_NOSIG) | |
| 664 | |
| 665 | |
| 666 /* List of symbols `coding-category-xxx' ordered by priority. This | |
| 667 variable is exposed to Emacs Lisp. */ | |
| 668 static Lisp_Object Vcoding_category_list; | |
| 669 | |
| 670 /* Table of coding categories (Lisp symbols). This variable is for | |
| 671 internal use oly. */ | |
| 672 static Lisp_Object Vcoding_category_table; | |
| 673 | |
| 674 /* Table of coding-categories ordered by priority. */ | |
| 675 static enum coding_category coding_priorities[coding_category_max]; | |
| 676 | |
| 677 /* Nth element is a coding context for the coding system bound to the | |
| 678 Nth coding category. */ | |
| 679 static struct coding_system coding_categories[coding_category_max]; | |
| 680 | |
| 681 /*** Commonly used macros and functions ***/ | |
| 682 | |
| 683 #ifndef min | |
| 684 #define min(a, b) ((a) < (b) ? (a) : (b)) | |
| 685 #endif | |
| 686 #ifndef max | |
| 687 #define max(a, b) ((a) > (b) ? (a) : (b)) | |
| 688 #endif | |
| 689 | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
690 #define CODING_GET_INFO(coding, attrs, charset_list) \ |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
691 do { \ |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
692 (attrs) = CODING_ID_ATTRS ((coding)->id); \ |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
693 (charset_list) = CODING_ATTR_CHARSET_LIST (attrs); \ |
| 88365 | 694 } while (0) |
| 695 | |
| 696 | |
| 697 /* Safely get one byte from the source text pointed by SRC which ends | |
| 698 at SRC_END, and set C to that byte. If there are not enough bytes | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
699 in the source, it jumps to `no_more_source'. If multibytep is |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
700 nonzero, and a multibyte character is found at SRC, set C to the |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
701 negative value of the character code. The caller should declare |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
702 and set these variables appropriately in advance: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
703 src, src_end, multibytep */ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
704 |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
705 #define ONE_MORE_BYTE(c) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
706 do { \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
707 if (src == src_end) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
708 { \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
709 if (src_base < src) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
710 record_conversion_result \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
711 (coding, CODING_RESULT_INSUFFICIENT_SRC); \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
712 goto no_more_source; \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
713 } \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
714 c = *src++; \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
715 if (multibytep && (c & 0x80)) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
716 { \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
717 if ((c & 0xFE) == 0xC0) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
718 c = ((c & 1) << 6) | *src++; \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
719 else \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
720 { \ |
|
90214
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
721 src--; \ |
|
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
722 c = - string_char (src, &src, NULL); \ |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
723 record_conversion_result \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
724 (coding, CODING_RESULT_INVALID_SRC); \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
725 } \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
726 } \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
727 consumed_chars++; \ |
| 88365 | 728 } while (0) |
| 729 | |
| 730 | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
731 #define ONE_MORE_BYTE_NO_CHECK(c) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
732 do { \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
733 c = *src++; \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
734 if (multibytep && (c & 0x80)) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
735 { \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
736 if ((c & 0xFE) == 0xC0) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
737 c = ((c & 1) << 6) | *src++; \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
738 else \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
739 { \ |
|
90214
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
740 src--; \ |
|
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
741 c = - string_char (src, &src, NULL); \ |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
742 record_conversion_result \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
743 (coding, CODING_RESULT_INVALID_SRC); \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
744 } \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
745 } \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
746 consumed_chars++; \ |
| 88365 | 747 } while (0) |
| 748 | |
| 749 | |
| 750 /* Store a byte C in the place pointed by DST and increment DST to the | |
| 751 next free point, and increment PRODUCED_CHARS. The caller should | |
| 752 assure that C is 0..127, and declare and set the variable `dst' | |
| 753 appropriately in advance. | |
| 754 */ | |
| 755 | |
| 756 | |
| 757 #define EMIT_ONE_ASCII_BYTE(c) \ | |
| 758 do { \ | |
| 759 produced_chars++; \ | |
| 760 *dst++ = (c); \ | |
| 761 } while (0) | |
| 762 | |
| 763 | |
| 764 /* Like EMIT_ONE_ASCII_BYTE byt store two bytes; C1 and C2. */ | |
| 765 | |
| 766 #define EMIT_TWO_ASCII_BYTES(c1, c2) \ | |
| 767 do { \ | |
| 768 produced_chars += 2; \ | |
| 769 *dst++ = (c1), *dst++ = (c2); \ | |
| 770 } while (0) | |
| 771 | |
| 772 | |
| 773 /* Store a byte C in the place pointed by DST and increment DST to the | |
| 774 next free point, and increment PRODUCED_CHARS. If MULTIBYTEP is | |
| 775 nonzero, store in an appropriate multibyte from. The caller should | |
| 776 declare and set the variables `dst' and `multibytep' appropriately | |
| 777 in advance. */ | |
| 778 | |
| 779 #define EMIT_ONE_BYTE(c) \ | |
| 780 do { \ | |
| 781 produced_chars++; \ | |
| 782 if (multibytep) \ | |
| 783 { \ | |
| 784 int ch = (c); \ | |
| 785 if (ch >= 0x80) \ | |
| 786 ch = BYTE8_TO_CHAR (ch); \ | |
| 787 CHAR_STRING_ADVANCE (ch, dst); \ | |
| 788 } \ | |
| 789 else \ | |
| 790 *dst++ = (c); \ | |
| 791 } while (0) | |
| 792 | |
| 793 | |
| 794 /* Like EMIT_ONE_BYTE, but emit two bytes; C1 and C2. */ | |
| 795 | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
796 #define EMIT_TWO_BYTES(c1, c2) \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
797 do { \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
798 produced_chars += 2; \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
799 if (multibytep) \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
800 { \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
801 int ch; \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
802 \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
803 ch = (c1); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
804 if (ch >= 0x80) \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
805 ch = BYTE8_TO_CHAR (ch); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
806 CHAR_STRING_ADVANCE (ch, dst); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
807 ch = (c2); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
808 if (ch >= 0x80) \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
809 ch = BYTE8_TO_CHAR (ch); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
810 CHAR_STRING_ADVANCE (ch, dst); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
811 } \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
812 else \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
813 { \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
814 *dst++ = (c1); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
815 *dst++ = (c2); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
816 } \ |
| 88365 | 817 } while (0) |
| 818 | |
| 819 | |
| 820 #define EMIT_THREE_BYTES(c1, c2, c3) \ | |
| 821 do { \ | |
| 822 EMIT_ONE_BYTE (c1); \ | |
| 823 EMIT_TWO_BYTES (c2, c3); \ | |
| 824 } while (0) | |
| 825 | |
| 826 | |
| 827 #define EMIT_FOUR_BYTES(c1, c2, c3, c4) \ | |
| 828 do { \ | |
| 829 EMIT_TWO_BYTES (c1, c2); \ | |
| 830 EMIT_TWO_BYTES (c3, c4); \ | |
| 831 } while (0) | |
| 832 | |
| 833 | |
|
89863
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
834 /* Prototypes for static functions. */ |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
835 static void record_conversion_result P_ ((struct coding_system *coding, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
836 enum coding_result_code result)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
837 static int detect_coding_utf_8 P_ ((struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
838 struct coding_detection_info *info)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
839 static void decode_coding_utf_8 P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
840 static int encode_coding_utf_8 P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
841 |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
842 static int detect_coding_utf_16 P_ ((struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
843 struct coding_detection_info *info)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
844 static void decode_coding_utf_16 P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
845 static int encode_coding_utf_16 P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
846 |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
847 static int detect_coding_iso_2022 P_ ((struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
848 struct coding_detection_info *info)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
849 static void decode_coding_iso_2022 P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
850 static int encode_coding_iso_2022 P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
851 |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
852 static int detect_coding_emacs_mule P_ ((struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
853 struct coding_detection_info *info)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
854 static void decode_coding_emacs_mule P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
855 static int encode_coding_emacs_mule P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
856 |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
857 static int detect_coding_sjis P_ ((struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
858 struct coding_detection_info *info)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
859 static void decode_coding_sjis P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
860 static int encode_coding_sjis P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
861 |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
862 static int detect_coding_big5 P_ ((struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
863 struct coding_detection_info *info)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
864 static void decode_coding_big5 P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
865 static int encode_coding_big5 P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
866 |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
867 static int detect_coding_ccl P_ ((struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
868 struct coding_detection_info *info)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
869 static void decode_coding_ccl P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
870 static int encode_coding_ccl P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
871 |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
872 static void decode_coding_raw_text P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
873 static int encode_coding_raw_text P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
874 |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
875 static void coding_set_source P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
876 static void coding_set_destination P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
877 static void coding_alloc_by_realloc P_ ((struct coding_system *, EMACS_INT)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
878 static void coding_alloc_by_making_gap P_ ((struct coding_system *, |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
879 EMACS_INT, EMACS_INT)); |
|
89863
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
880 static unsigned char *alloc_destination P_ ((struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
881 EMACS_INT, unsigned char *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
882 static void setup_iso_safe_charsets P_ ((Lisp_Object)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
883 static unsigned char *encode_designation_at_bol P_ ((struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
884 int *, int *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
885 unsigned char *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
886 static int detect_eol P_ ((const unsigned char *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
887 EMACS_INT, enum coding_category)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
888 static Lisp_Object adjust_coding_eol_type P_ ((struct coding_system *, int)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
889 static void decode_eol P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
890 static Lisp_Object get_translation_table P_ ((Lisp_Object, int, int *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
891 static Lisp_Object get_translation P_ ((Lisp_Object, int *, int *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
892 int, int *, int *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
893 static int produce_chars P_ ((struct coding_system *, Lisp_Object, int)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
894 static INLINE void produce_composition P_ ((struct coding_system *, int *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
895 EMACS_INT)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
896 static INLINE void produce_charset P_ ((struct coding_system *, int *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
897 EMACS_INT)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
898 static void produce_annotation P_ ((struct coding_system *, EMACS_INT)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
899 static int decode_coding P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
900 static INLINE int *handle_composition_annotation P_ ((EMACS_INT, EMACS_INT, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
901 struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
902 int *, EMACS_INT *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
903 static INLINE int *handle_charset_annotation P_ ((EMACS_INT, EMACS_INT, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
904 struct coding_system *, |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
905 int *, EMACS_INT *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
906 static void consume_chars P_ ((struct coding_system *, Lisp_Object, int)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
907 static int encode_coding P_ ((struct coding_system *)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
908 static Lisp_Object make_conversion_work_buffer P_ ((int)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
909 static Lisp_Object code_conversion_restore P_ ((Lisp_Object)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
910 static INLINE int char_encodable_p P_ ((int, Lisp_Object)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
911 static Lisp_Object make_subsidiaries P_ ((Lisp_Object)); |
|
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
912 |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
913 static void |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
914 record_conversion_result (struct coding_system *coding, |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
915 enum coding_result_code result) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
916 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
917 coding->result = result; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
918 switch (result) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
919 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
920 case CODING_RESULT_INSUFFICIENT_SRC: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
921 Vlast_code_conversion_error = Qinsufficient_source; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
922 break; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
923 case CODING_RESULT_INCONSISTENT_EOL: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
924 Vlast_code_conversion_error = Qinconsistent_eol; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
925 break; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
926 case CODING_RESULT_INVALID_SRC: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
927 Vlast_code_conversion_error = Qinvalid_source; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
928 break; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
929 case CODING_RESULT_INTERRUPT: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
930 Vlast_code_conversion_error = Qinterrupted; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
931 break; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
932 case CODING_RESULT_INSUFFICIENT_MEM: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
933 Vlast_code_conversion_error = Qinsufficient_memory; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
934 break; |
|
90214
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
935 default: |
|
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
936 Vlast_code_conversion_error = intern ("Unknown error"); |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
937 } |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
938 } |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
939 |
| 88365 | 940 #define CODING_DECODE_CHAR(coding, src, src_base, src_end, charset, code, c) \ |
| 941 do { \ | |
| 942 charset_map_loaded = 0; \ | |
| 943 c = DECODE_CHAR (charset, code); \ | |
| 944 if (charset_map_loaded) \ | |
| 945 { \ | |
| 89483 | 946 const unsigned char *orig = coding->source; \ |
| 88365 | 947 EMACS_INT offset; \ |
| 948 \ | |
| 949 coding_set_source (coding); \ | |
| 950 offset = coding->source - orig; \ | |
| 951 src += offset; \ | |
| 952 src_base += offset; \ | |
| 953 src_end += offset; \ | |
| 954 } \ | |
| 955 } while (0) | |
| 956 | |
| 957 | |
| 958 #define ASSURE_DESTINATION(bytes) \ | |
| 959 do { \ | |
| 960 if (dst + (bytes) >= dst_end) \ | |
| 961 { \ | |
| 962 int more_bytes = charbuf_end - charbuf + (bytes); \ | |
| 963 \ | |
| 964 dst = alloc_destination (coding, more_bytes, dst); \ | |
| 965 dst_end = coding->destination + coding->dst_bytes; \ | |
| 966 } \ | |
| 967 } while (0) | |
| 968 | |
| 969 | |
| 970 | |
| 971 static void | |
| 972 coding_set_source (coding) | |
| 973 struct coding_system *coding; | |
| 974 { | |
| 975 if (BUFFERP (coding->src_object)) | |
| 976 { | |
|
89418
a9c2b3712863
(coding_set_source): Fix for the case that the current
Kenichi Handa <handa@m17n.org>
parents:
89404
diff
changeset
|
977 struct buffer *buf = XBUFFER (coding->src_object); |
|
a9c2b3712863
(coding_set_source): Fix for the case that the current
Kenichi Handa <handa@m17n.org>
parents:
89404
diff
changeset
|
978 |
| 88365 | 979 if (coding->src_pos < 0) |
|
89418
a9c2b3712863
(coding_set_source): Fix for the case that the current
Kenichi Handa <handa@m17n.org>
parents:
89404
diff
changeset
|
980 coding->source = BUF_GAP_END_ADDR (buf) + coding->src_pos_byte; |
| 88365 | 981 else |
|
89418
a9c2b3712863
(coding_set_source): Fix for the case that the current
Kenichi Handa <handa@m17n.org>
parents:
89404
diff
changeset
|
982 coding->source = BUF_BYTE_ADDRESS (buf, coding->src_pos_byte); |
| 88365 | 983 } |
| 984 else if (STRINGP (coding->src_object)) | |
| 985 { | |
| 89483 | 986 coding->source = SDATA (coding->src_object) + coding->src_pos_byte; |
| 88365 | 987 } |
| 988 else | |
| 989 /* Otherwise, the source is C string and is never relocated | |
| 990 automatically. Thus we don't have to update anything. */ | |
| 991 ; | |
| 992 } | |
| 993 | |
| 994 static void | |
| 995 coding_set_destination (coding) | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
996 struct coding_system *coding; |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
997 { |
| 88365 | 998 if (BUFFERP (coding->dst_object)) |
| 999 { | |
| 1000 if (coding->src_pos < 0) | |
|
89042
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1001 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1002 coding->destination = BEG_ADDR + coding->dst_pos_byte - 1; |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1003 coding->dst_bytes = (GAP_END_ADDR |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1004 - (coding->src_bytes - coding->consumed) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1005 - coding->destination); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1006 } |
| 88365 | 1007 else |
|
89042
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1008 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1009 /* We are sure that coding->dst_pos_byte is before the gap |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1010 of the buffer. */ |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1011 coding->destination = (BUF_BEG_ADDR (XBUFFER (coding->dst_object)) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1012 + coding->dst_pos_byte - 1); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1013 coding->dst_bytes = (BUF_GAP_END_ADDR (XBUFFER (coding->dst_object)) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1014 - coding->destination); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1015 } |
| 88365 | 1016 } |
| 1017 else | |
| 1018 /* Otherwise, the destination is C string and is never relocated | |
| 1019 automatically. Thus we don't have to update anything. */ | |
| 1020 ; | |
| 1021 } | |
| 1022 | |
| 1023 | |
| 1024 static void | |
| 1025 coding_alloc_by_realloc (coding, bytes) | |
| 1026 struct coding_system *coding; | |
| 1027 EMACS_INT bytes; | |
| 1028 { | |
| 1029 coding->destination = (unsigned char *) xrealloc (coding->destination, | |
| 1030 coding->dst_bytes + bytes); | |
| 1031 coding->dst_bytes += bytes; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
1032 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
1033 |
| 88365 | 1034 static void |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
1035 coding_alloc_by_making_gap (coding, offset, bytes) |
| 88365 | 1036 struct coding_system *coding; |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
1037 EMACS_INT offset, bytes; |
| 88365 | 1038 { |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
1039 if (BUFFERP (coding->dst_object) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
1040 && EQ (coding->src_object, coding->dst_object)) |
| 88365 | 1041 { |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
1042 EMACS_INT add = offset + (coding->src_bytes - coding->consumed); |
|
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
1043 |
|
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
1044 GPT += offset, GPT_BYTE += offset; |
| 88365 | 1045 GAP_SIZE -= add; ZV += add; Z += add; ZV_BYTE += add; Z_BYTE += add; |
| 1046 make_gap (bytes); | |
| 1047 GAP_SIZE += add; ZV -= add; Z -= add; ZV_BYTE -= add; Z_BYTE -= add; | |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
1048 GPT -= offset, GPT_BYTE -= offset; |
| 88365 | 1049 } |
|
90292
697c08d95af7
Cancel incorrect synching with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90291
diff
changeset
|
1050 else |
| 88365 | 1051 { |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
1052 Lisp_Object this_buffer; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
1053 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
1054 this_buffer = Fcurrent_buffer (); |
| 88365 | 1055 set_buffer_internal (XBUFFER (coding->dst_object)); |
| 1056 make_gap (bytes); | |
| 1057 set_buffer_internal (XBUFFER (this_buffer)); | |
| 1058 } | |
| 1059 } | |
| 89483 | 1060 |
| 88365 | 1061 |
| 1062 static unsigned char * | |
| 1063 alloc_destination (coding, nbytes, dst) | |
| 1064 struct coding_system *coding; | |
|
89545
4f394eed6ff2
(inhibit_pre_post_conversion): Removed (unused).
Dave Love <fx@gnu.org>
parents:
89519
diff
changeset
|
1065 EMACS_INT nbytes; |
| 88365 | 1066 unsigned char *dst; |
| 1067 { | |
| 1068 EMACS_INT offset = dst - coding->destination; | |
| 1069 | |
| 1070 if (BUFFERP (coding->dst_object)) | |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
1071 coding_alloc_by_making_gap (coding, offset, nbytes); |
| 88365 | 1072 else |
| 1073 coding_alloc_by_realloc (coding, nbytes); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1074 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 1075 coding_set_destination (coding); |
| 1076 dst = coding->destination + offset; | |
| 1077 return dst; | |
| 1078 } | |
| 1079 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1080 /** Macros for annotations. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1081 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1082 /* Maximum length of annotation data (sum of annotations for |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1083 composition and charset). */ |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1084 #define MAX_ANNOTATION_LENGTH (4 + (MAX_COMPOSITION_COMPONENTS * 2) - 1 + 4) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1085 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1086 /* An annotation data is stored in the array coding->charbuf in this |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1087 format: |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1088 [ -LENGTH ANNOTATION_MASK NCHARS ... ] |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1089 LENGTH is the number of elements in the annotation. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1090 ANNOTATION_MASK is one of CODING_ANNOTATE_XXX_MASK. |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1091 NCHARS is the number of characters in the text annotated. |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1092 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1093 The format of the following elements depend on ANNOTATION_MASK. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1094 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1095 In the case of CODING_ANNOTATE_COMPOSITION_MASK, these elements |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1096 follows: |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1097 ... METHOD [ COMPOSITION-COMPONENTS ... ] |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1098 METHOD is one of enum composition_method. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1099 Optionnal COMPOSITION-COMPONENTS are characters and composition |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1100 rules. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1101 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1102 In the case of CODING_ANNOTATE_CHARSET_MASK, one element CHARSET-ID |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1103 follows. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1104 |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1105 #define ADD_ANNOTATION_DATA(buf, len, mask, nchars) \ |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1106 do { \ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1107 *(buf)++ = -(len); \ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1108 *(buf)++ = (mask); \ |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1109 *(buf)++ = (nchars); \ |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1110 coding->annotated = 1; \ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1111 } while (0); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1112 |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1113 #define ADD_COMPOSITION_DATA(buf, nchars, method) \ |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1114 do { \ |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1115 ADD_ANNOTATION_DATA (buf, 4, CODING_ANNOTATE_COMPOSITION_MASK, nchars); \ |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1116 *buf++ = method; \ |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1117 } while (0) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1118 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1119 |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1120 #define ADD_CHARSET_DATA(buf, nchars, id) \ |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1121 do { \ |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1122 ADD_ANNOTATION_DATA (buf, 4, CODING_ANNOTATE_CHARSET_MASK, nchars); \ |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1123 *buf++ = id; \ |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1124 } while (0) |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
1125 |
| 17052 | 1126 |
| 88365 | 1127 /*** 2. Emacs' internal format (emacs-utf-8) ***/ |
| 1128 | |
| 1129 | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
1130 |
| 17052 | 1131 |
| 88365 | 1132 /*** 3. UTF-8 ***/ |
| 1133 | |
| 1134 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1135 Check if a text is encoded in UTF-8. If it is, return 1, else |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1136 return 0. */ |
| 88365 | 1137 |
| 1138 #define UTF_8_1_OCTET_P(c) ((c) < 0x80) | |
| 1139 #define UTF_8_EXTRA_OCTET_P(c) (((c) & 0xC0) == 0x80) | |
| 1140 #define UTF_8_2_OCTET_LEADING_P(c) (((c) & 0xE0) == 0xC0) | |
| 1141 #define UTF_8_3_OCTET_LEADING_P(c) (((c) & 0xF0) == 0xE0) | |
| 1142 #define UTF_8_4_OCTET_LEADING_P(c) (((c) & 0xF8) == 0xF0) | |
| 1143 #define UTF_8_5_OCTET_LEADING_P(c) (((c) & 0xFC) == 0xF8) | |
| 1144 | |
| 1145 static int | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1146 detect_coding_utf_8 (coding, detect_info) |
| 88365 | 1147 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1148 struct coding_detection_info *detect_info; |
| 88365 | 1149 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1150 const unsigned char *src = coding->source, *src_base; |
| 89483 | 1151 const unsigned char *src_end = coding->source + coding->src_bytes; |
| 88365 | 1152 int multibytep = coding->src_multibyte; |
| 1153 int consumed_chars = 0; | |
| 1154 int found = 0; | |
| 1155 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1156 detect_info->checked |= CATEGORY_MASK_UTF_8; |
| 88365 | 1157 /* A coding system of this category is always ASCII compatible. */ |
| 1158 src += coding->head_ascii; | |
| 1159 | |
| 1160 while (1) | |
| 1161 { | |
| 1162 int c, c1, c2, c3, c4; | |
| 1163 | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1164 src_base = src; |
| 88365 | 1165 ONE_MORE_BYTE (c); |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1166 if (c < 0 || UTF_8_1_OCTET_P (c)) |
| 88365 | 1167 continue; |
| 1168 ONE_MORE_BYTE (c1); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1169 if (c1 < 0 || ! UTF_8_EXTRA_OCTET_P (c1)) |
| 88365 | 1170 break; |
| 1171 if (UTF_8_2_OCTET_LEADING_P (c)) | |
| 1172 { | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1173 found = CATEGORY_MASK_UTF_8; |
| 88365 | 1174 continue; |
| 1175 } | |
| 1176 ONE_MORE_BYTE (c2); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1177 if (c2 < 0 || ! UTF_8_EXTRA_OCTET_P (c2)) |
| 88365 | 1178 break; |
| 1179 if (UTF_8_3_OCTET_LEADING_P (c)) | |
| 1180 { | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1181 found = CATEGORY_MASK_UTF_8; |
| 88365 | 1182 continue; |
| 1183 } | |
| 1184 ONE_MORE_BYTE (c3); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1185 if (c3 < 0 || ! UTF_8_EXTRA_OCTET_P (c3)) |
| 88365 | 1186 break; |
| 1187 if (UTF_8_4_OCTET_LEADING_P (c)) | |
| 1188 { | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1189 found = CATEGORY_MASK_UTF_8; |
| 88365 | 1190 continue; |
| 1191 } | |
| 1192 ONE_MORE_BYTE (c4); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1193 if (c4 < 0 || ! UTF_8_EXTRA_OCTET_P (c4)) |
| 88365 | 1194 break; |
| 1195 if (UTF_8_5_OCTET_LEADING_P (c)) | |
| 1196 { | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1197 found = CATEGORY_MASK_UTF_8; |
| 88365 | 1198 continue; |
| 1199 } | |
| 1200 break; | |
| 1201 } | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1202 detect_info->rejected |= CATEGORY_MASK_UTF_8; |
| 88365 | 1203 return 0; |
| 1204 | |
| 1205 no_more_source: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1206 if (src_base < src && coding->mode & CODING_MODE_LAST_BLOCK) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1207 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1208 detect_info->rejected |= CATEGORY_MASK_UTF_8; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1209 return 0; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1210 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1211 detect_info->found |= found; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1212 return 1; |
| 88365 | 1213 } |
| 1214 | |
| 1215 | |
| 1216 static void | |
| 1217 decode_coding_utf_8 (coding) | |
| 1218 struct coding_system *coding; | |
| 1219 { | |
| 89483 | 1220 const unsigned char *src = coding->source + coding->consumed; |
| 1221 const unsigned char *src_end = coding->source + coding->src_bytes; | |
| 1222 const unsigned char *src_base; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1223 int *charbuf = coding->charbuf + coding->charbuf_used; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1224 int *charbuf_end = coding->charbuf + coding->charbuf_size; |
| 88365 | 1225 int consumed_chars = 0, consumed_chars_base; |
| 1226 int multibytep = coding->src_multibyte; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1227 Lisp_Object attr, charset_list; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1228 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1229 CODING_GET_INFO (coding, attr, charset_list); |
| 88365 | 1230 |
| 1231 while (1) | |
| 1232 { | |
| 1233 int c, c1, c2, c3, c4, c5; | |
| 1234 | |
| 1235 src_base = src; | |
| 1236 consumed_chars_base = consumed_chars; | |
| 1237 | |
| 1238 if (charbuf >= charbuf_end) | |
| 1239 break; | |
| 1240 | |
| 1241 ONE_MORE_BYTE (c1); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1242 if (c1 < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1243 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1244 c = - c1; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1245 } |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1246 else if (UTF_8_1_OCTET_P(c1)) |
| 88365 | 1247 { |
| 1248 c = c1; | |
| 1249 } | |
| 1250 else | |
| 1251 { | |
| 1252 ONE_MORE_BYTE (c2); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1253 if (c2 < 0 || ! UTF_8_EXTRA_OCTET_P (c2)) |
| 88365 | 1254 goto invalid_code; |
| 1255 if (UTF_8_2_OCTET_LEADING_P (c1)) | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1256 { |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1257 c = ((c1 & 0x1F) << 6) | (c2 & 0x3F); |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1258 /* Reject overlong sequences here and below. Encoders |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1259 producing them are incorrect, they can be misleading, |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1260 and they mess up read/write invariance. */ |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1261 if (c < 128) |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1262 goto invalid_code; |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1263 } |
| 88365 | 1264 else |
| 1265 { | |
| 1266 ONE_MORE_BYTE (c3); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1267 if (c3 < 0 || ! UTF_8_EXTRA_OCTET_P (c3)) |
| 88365 | 1268 goto invalid_code; |
| 1269 if (UTF_8_3_OCTET_LEADING_P (c1)) | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1270 { |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1271 c = (((c1 & 0xF) << 12) |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1272 | ((c2 & 0x3F) << 6) | (c3 & 0x3F)); |
|
89184
88a9e962e183
(decode_coding_utf_8): Treat surrogates as invalid.
Dave Love <fx@gnu.org>
parents:
89042
diff
changeset
|
1273 if (c < 0x800 |
|
88a9e962e183
(decode_coding_utf_8): Treat surrogates as invalid.
Dave Love <fx@gnu.org>
parents:
89042
diff
changeset
|
1274 || (c >= 0xd800 && c < 0xe000)) /* surrogates (invalid) */ |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1275 goto invalid_code; |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1276 } |
| 88365 | 1277 else |
| 1278 { | |
| 1279 ONE_MORE_BYTE (c4); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1280 if (c4 < 0 || ! UTF_8_EXTRA_OCTET_P (c4)) |
| 88365 | 1281 goto invalid_code; |
| 1282 if (UTF_8_4_OCTET_LEADING_P (c1)) | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1283 { |
| 88365 | 1284 c = (((c1 & 0x7) << 18) | ((c2 & 0x3F) << 12) |
| 1285 | ((c3 & 0x3F) << 6) | (c4 & 0x3F)); | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1286 if (c < 0x10000) |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1287 goto invalid_code; |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1288 } |
| 88365 | 1289 else |
| 1290 { | |
| 1291 ONE_MORE_BYTE (c5); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1292 if (c5 < 0 || ! UTF_8_EXTRA_OCTET_P (c5)) |
| 88365 | 1293 goto invalid_code; |
| 1294 if (UTF_8_5_OCTET_LEADING_P (c1)) | |
| 1295 { | |
| 1296 c = (((c1 & 0x3) << 24) | ((c2 & 0x3F) << 18) | |
| 1297 | ((c3 & 0x3F) << 12) | ((c4 & 0x3F) << 6) | |
| 1298 | (c5 & 0x3F)); | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1299 if ((c > MAX_CHAR) || (c < 0x200000)) |
| 88365 | 1300 goto invalid_code; |
| 1301 } | |
| 1302 else | |
| 1303 goto invalid_code; | |
| 1304 } | |
| 1305 } | |
| 1306 } | |
| 1307 } | |
| 1308 | |
| 1309 *charbuf++ = c; | |
| 1310 continue; | |
| 1311 | |
| 1312 invalid_code: | |
| 1313 src = src_base; | |
| 1314 consumed_chars = consumed_chars_base; | |
| 1315 ONE_MORE_BYTE (c); | |
| 1316 *charbuf++ = ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); | |
| 1317 coding->errors++; | |
| 1318 } | |
| 1319 | |
| 1320 no_more_source: | |
| 1321 coding->consumed_char += consumed_chars_base; | |
| 1322 coding->consumed = src_base - coding->source; | |
| 1323 coding->charbuf_used = charbuf - coding->charbuf; | |
| 1324 } | |
| 1325 | |
| 1326 | |
| 1327 static int | |
| 1328 encode_coding_utf_8 (coding) | |
| 1329 struct coding_system *coding; | |
| 1330 { | |
| 1331 int multibytep = coding->dst_multibyte; | |
| 1332 int *charbuf = coding->charbuf; | |
| 1333 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 1334 unsigned char *dst = coding->destination + coding->produced; | |
| 1335 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1336 int produced_chars = 0; |
| 88365 | 1337 int c; |
| 1338 | |
| 1339 if (multibytep) | |
| 1340 { | |
| 1341 int safe_room = MAX_MULTIBYTE_LENGTH * 2; | |
| 1342 | |
| 1343 while (charbuf < charbuf_end) | |
| 1344 { | |
| 1345 unsigned char str[MAX_MULTIBYTE_LENGTH], *p, *pend = str; | |
| 89483 | 1346 |
| 88365 | 1347 ASSURE_DESTINATION (safe_room); |
| 1348 c = *charbuf++; | |
|
89042
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1349 if (CHAR_BYTE8_P (c)) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1350 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1351 c = CHAR_TO_BYTE8 (c); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1352 EMIT_ONE_BYTE (c); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1353 } |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1354 else |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1355 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1356 CHAR_STRING_ADVANCE (c, pend); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1357 for (p = str; p < pend; p++) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1358 EMIT_ONE_BYTE (*p); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1359 } |
| 88365 | 1360 } |
| 1361 } | |
| 1362 else | |
| 1363 { | |
| 1364 int safe_room = MAX_MULTIBYTE_LENGTH; | |
| 1365 | |
| 1366 while (charbuf < charbuf_end) | |
| 1367 { | |
| 1368 ASSURE_DESTINATION (safe_room); | |
| 1369 c = *charbuf++; | |
|
89917
1763eef5ad02
(encode_coding_utf_8): Fix handling of raw-byte char.
Kenichi Handa <handa@m17n.org>
parents:
89905
diff
changeset
|
1370 if (CHAR_BYTE8_P (c)) |
|
1763eef5ad02
(encode_coding_utf_8): Fix handling of raw-byte char.
Kenichi Handa <handa@m17n.org>
parents:
89905
diff
changeset
|
1371 *dst++ = CHAR_TO_BYTE8 (c); |
|
1763eef5ad02
(encode_coding_utf_8): Fix handling of raw-byte char.
Kenichi Handa <handa@m17n.org>
parents:
89905
diff
changeset
|
1372 else |
|
1763eef5ad02
(encode_coding_utf_8): Fix handling of raw-byte char.
Kenichi Handa <handa@m17n.org>
parents:
89905
diff
changeset
|
1373 dst += CHAR_STRING (c, dst); |
| 88365 | 1374 produced_chars++; |
| 1375 } | |
| 1376 } | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1377 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 1378 coding->produced_char += produced_chars; |
| 1379 coding->produced = dst - coding->destination; | |
| 1380 return 0; | |
| 1381 } | |
| 1382 | |
| 1383 | |
| 1384 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1385 Check if a text is encoded in one of UTF-16 based coding systems. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1386 If it is, return 1, else return 0. */ |
| 88365 | 1387 |
| 1388 #define UTF_16_HIGH_SURROGATE_P(val) \ | |
| 1389 (((val) & 0xFC00) == 0xD800) | |
| 1390 | |
| 1391 #define UTF_16_LOW_SURROGATE_P(val) \ | |
| 1392 (((val) & 0xFC00) == 0xDC00) | |
| 1393 | |
| 1394 #define UTF_16_INVALID_P(val) \ | |
| 1395 (((val) == 0xFFFE) \ | |
| 1396 || ((val) == 0xFFFF) \ | |
| 1397 || UTF_16_LOW_SURROGATE_P (val)) | |
| 1398 | |
| 1399 | |
| 1400 static int | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1401 detect_coding_utf_16 (coding, detect_info) |
| 88365 | 1402 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1403 struct coding_detection_info *detect_info; |
| 88365 | 1404 { |
| 89483 | 1405 const unsigned char *src = coding->source, *src_base = src; |
| 1406 const unsigned char *src_end = coding->source + coding->src_bytes; | |
| 88365 | 1407 int multibytep = coding->src_multibyte; |
| 1408 int consumed_chars = 0; | |
| 1409 int c1, c2; | |
| 1410 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1411 detect_info->checked |= CATEGORY_MASK_UTF_16; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1412 if (coding->mode & CODING_MODE_LAST_BLOCK |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1413 && (coding->src_chars & 1)) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1414 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1415 detect_info->rejected |= CATEGORY_MASK_UTF_16; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1416 return 0; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1417 } |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1418 |
| 88365 | 1419 ONE_MORE_BYTE (c1); |
| 1420 ONE_MORE_BYTE (c2); | |
| 1421 if ((c1 == 0xFF) && (c2 == 0xFE)) | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1422 { |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1423 detect_info->found |= (CATEGORY_MASK_UTF_16_LE |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1424 | CATEGORY_MASK_UTF_16_AUTO); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1425 detect_info->rejected |= (CATEGORY_MASK_UTF_16_BE |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1426 | CATEGORY_MASK_UTF_16_BE_NOSIG |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1427 | CATEGORY_MASK_UTF_16_LE_NOSIG); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1428 } |
| 88365 | 1429 else if ((c1 == 0xFE) && (c2 == 0xFF)) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1430 { |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1431 detect_info->found |= (CATEGORY_MASK_UTF_16_BE |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1432 | CATEGORY_MASK_UTF_16_AUTO); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1433 detect_info->rejected |= (CATEGORY_MASK_UTF_16_LE |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1434 | CATEGORY_MASK_UTF_16_BE_NOSIG |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1435 | CATEGORY_MASK_UTF_16_LE_NOSIG); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1436 } |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1437 else if (c1 >= 0 && c2 >= 0) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1438 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1439 detect_info->rejected |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1440 |= (CATEGORY_MASK_UTF_16_BE | CATEGORY_MASK_UTF_16_LE); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1441 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1442 no_more_source: |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1443 return 1; |
| 88365 | 1444 } |
| 1445 | |
| 1446 static void | |
| 1447 decode_coding_utf_16 (coding) | |
| 1448 struct coding_system *coding; | |
| 1449 { | |
| 89483 | 1450 const unsigned char *src = coding->source + coding->consumed; |
| 1451 const unsigned char *src_end = coding->source + coding->src_bytes; | |
| 1452 const unsigned char *src_base; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1453 int *charbuf = coding->charbuf + coding->charbuf_used; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1454 int *charbuf_end = coding->charbuf + coding->charbuf_size; |
| 88365 | 1455 int consumed_chars = 0, consumed_chars_base; |
| 1456 int multibytep = coding->src_multibyte; | |
| 1457 enum utf_16_bom_type bom = CODING_UTF_16_BOM (coding); | |
| 1458 enum utf_16_endian_type endian = CODING_UTF_16_ENDIAN (coding); | |
| 1459 int surrogate = CODING_UTF_16_SURROGATE (coding); | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1460 Lisp_Object attr, charset_list; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1461 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1462 CODING_GET_INFO (coding, attr, charset_list); |
| 88365 | 1463 |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1464 if (bom == utf_16_with_bom) |
| 88365 | 1465 { |
| 1466 int c, c1, c2; | |
| 1467 | |
| 1468 src_base = src; | |
| 1469 ONE_MORE_BYTE (c1); | |
| 1470 ONE_MORE_BYTE (c2); | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1471 c = (c1 << 8) | c2; |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1472 |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1473 if (endian == utf_16_big_endian |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1474 ? c != 0xFEFF : c != 0xFFFE) |
| 88365 | 1475 { |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1476 /* The first two bytes are not BOM. Treat them as bytes |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1477 for a normal character. */ |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1478 src = src_base; |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1479 coding->errors++; |
| 88365 | 1480 } |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1481 CODING_UTF_16_BOM (coding) = utf_16_without_bom; |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1482 } |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1483 else if (bom == utf_16_detect_bom) |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1484 { |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1485 /* We have already tried to detect BOM and failed in |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1486 detect_coding. */ |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1487 CODING_UTF_16_BOM (coding) = utf_16_without_bom; |
| 88365 | 1488 } |
| 1489 | |
| 1490 while (1) | |
| 1491 { | |
| 1492 int c, c1, c2; | |
| 1493 | |
| 1494 src_base = src; | |
| 1495 consumed_chars_base = consumed_chars; | |
| 1496 | |
| 1497 if (charbuf + 2 >= charbuf_end) | |
| 1498 break; | |
| 1499 | |
| 1500 ONE_MORE_BYTE (c1); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1501 if (c1 < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1502 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1503 *charbuf++ = -c1; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1504 continue; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1505 } |
| 88365 | 1506 ONE_MORE_BYTE (c2); |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1507 if (c2 < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1508 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1509 *charbuf++ = ASCII_BYTE_P (c1) ? c1 : BYTE8_TO_CHAR (c1); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1510 *charbuf++ = -c2; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1511 continue; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1512 } |
| 88365 | 1513 c = (endian == utf_16_big_endian |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1514 ? ((c1 << 8) | c2) : ((c2 << 8) | c1)); |
| 88365 | 1515 if (surrogate) |
| 1516 { | |
| 1517 if (! UTF_16_LOW_SURROGATE_P (c)) | |
| 1518 { | |
| 1519 if (endian == utf_16_big_endian) | |
| 1520 c1 = surrogate >> 8, c2 = surrogate & 0xFF; | |
| 1521 else | |
| 1522 c1 = surrogate & 0xFF, c2 = surrogate >> 8; | |
| 1523 *charbuf++ = c1; | |
| 1524 *charbuf++ = c2; | |
| 1525 coding->errors++; | |
| 1526 if (UTF_16_HIGH_SURROGATE_P (c)) | |
| 1527 CODING_UTF_16_SURROGATE (coding) = surrogate = c; | |
| 1528 else | |
| 1529 *charbuf++ = c; | |
| 1530 } | |
| 1531 else | |
| 1532 { | |
| 1533 c = ((surrogate - 0xD800) << 10) | (c - 0xDC00); | |
| 1534 CODING_UTF_16_SURROGATE (coding) = surrogate = 0; | |
|
89842
b5f22f538c1f
(decode_coding_utf_16): Fix handling of surrogate pare.
Kenichi Handa <handa@m17n.org>
parents:
89780
diff
changeset
|
1535 *charbuf++ = 0x10000 + c; |
| 88365 | 1536 } |
| 1537 } | |
| 1538 else | |
| 1539 { | |
| 1540 if (UTF_16_HIGH_SURROGATE_P (c)) | |
| 1541 CODING_UTF_16_SURROGATE (coding) = surrogate = c; | |
| 1542 else | |
| 1543 *charbuf++ = c; | |
| 89483 | 1544 } |
| 88365 | 1545 } |
| 1546 | |
| 1547 no_more_source: | |
| 1548 coding->consumed_char += consumed_chars_base; | |
| 1549 coding->consumed = src_base - coding->source; | |
| 1550 coding->charbuf_used = charbuf - coding->charbuf; | |
| 1551 } | |
| 1552 | |
| 1553 static int | |
| 1554 encode_coding_utf_16 (coding) | |
| 1555 struct coding_system *coding; | |
| 1556 { | |
| 1557 int multibytep = coding->dst_multibyte; | |
| 1558 int *charbuf = coding->charbuf; | |
| 1559 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 1560 unsigned char *dst = coding->destination + coding->produced; | |
| 1561 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 1562 int safe_room = 8; | |
| 1563 enum utf_16_bom_type bom = CODING_UTF_16_BOM (coding); | |
| 1564 int big_endian = CODING_UTF_16_ENDIAN (coding) == utf_16_big_endian; | |
| 1565 int produced_chars = 0; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1566 Lisp_Object attrs, charset_list; |
| 88365 | 1567 int c; |
| 1568 | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
1569 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 1570 |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
1571 if (bom != utf_16_without_bom) |
| 88365 | 1572 { |
| 1573 ASSURE_DESTINATION (safe_room); | |
| 1574 if (big_endian) | |
|
89404
3e1d187b52c3
(Qutf_16_be_nosig, Qutf_16_be, Qutf_16_le_nosig)
Kenichi Handa <handa@m17n.org>
parents:
89394
diff
changeset
|
1575 EMIT_TWO_BYTES (0xFE, 0xFF); |
| 88365 | 1576 else |
|
89404
3e1d187b52c3
(Qutf_16_be_nosig, Qutf_16_be, Qutf_16_le_nosig)
Kenichi Handa <handa@m17n.org>
parents:
89394
diff
changeset
|
1577 EMIT_TWO_BYTES (0xFF, 0xFE); |
| 88365 | 1578 CODING_UTF_16_BOM (coding) = utf_16_without_bom; |
| 1579 } | |
| 1580 | |
| 1581 while (charbuf < charbuf_end) | |
| 1582 { | |
| 1583 ASSURE_DESTINATION (safe_room); | |
| 1584 c = *charbuf++; | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1585 if (c >= MAX_UNICODE_CHAR) |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1586 c = coding->default_char; |
| 88365 | 1587 |
| 1588 if (c < 0x10000) | |
| 1589 { | |
| 1590 if (big_endian) | |
| 1591 EMIT_TWO_BYTES (c >> 8, c & 0xFF); | |
| 1592 else | |
| 1593 EMIT_TWO_BYTES (c & 0xFF, c >> 8); | |
| 1594 } | |
| 1595 else | |
| 1596 { | |
| 1597 int c1, c2; | |
| 1598 | |
| 1599 c -= 0x10000; | |
| 1600 c1 = (c >> 10) + 0xD800; | |
| 1601 c2 = (c & 0x3FF) + 0xDC00; | |
| 1602 if (big_endian) | |
| 1603 EMIT_FOUR_BYTES (c1 >> 8, c1 & 0xFF, c2 >> 8, c2 & 0xFF); | |
| 1604 else | |
| 1605 EMIT_FOUR_BYTES (c1 & 0xFF, c1 >> 8, c2 & 0xFF, c2 >> 8); | |
| 1606 } | |
| 1607 } | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1608 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 1609 coding->produced = dst - coding->destination; |
| 1610 coding->produced_char += produced_chars; | |
| 1611 return 0; | |
| 1612 } | |
| 1613 | |
| 1614 | |
| 1615 /*** 6. Old Emacs' internal format (emacs-mule) ***/ | |
| 17052 | 1616 |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1617 /* Emacs' internal format for representation of multiple character |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1618 sets is a kind of multi-byte encoding, i.e. characters are |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1619 represented by variable-length sequences of one-byte codes. |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1620 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1621 ASCII characters and control characters (e.g. `tab', `newline') are |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1622 represented by one-byte sequences which are their ASCII codes, in |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1623 the range 0x00 through 0x7F. |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1624 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1625 8-bit characters of the range 0x80..0x9F are represented by |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1626 two-byte sequences of LEADING_CODE_8_BIT_CONTROL and (their 8-bit |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1627 code + 0x20). |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1628 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1629 8-bit characters of the range 0xA0..0xFF are represented by |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1630 one-byte sequences which are their 8-bit code. |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1631 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1632 The other characters are represented by a sequence of `base |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1633 leading-code', optional `extended leading-code', and one or two |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1634 `position-code's. The length of the sequence is determined by the |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1635 base leading-code. Leading-code takes the range 0x81 through 0x9D, |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1636 whereas extended leading-code and position-code take the range 0xA0 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1637 through 0xFF. See `charset.h' for more details about leading-code |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1638 and position-code. |
| 18766 | 1639 |
| 17052 | 1640 --- CODE RANGE of Emacs' internal format --- |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1641 character set range |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1642 ------------- ----- |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1643 ascii 0x00..0x7F |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1644 eight-bit-control LEADING_CODE_8_BIT_CONTROL + 0xA0..0xBF |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1645 eight-bit-graphic 0xA0..0xBF |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1646 ELSE 0x81..0x9D + [0xA0..0xFF]+ |
| 17052 | 1647 --------------------------------------------- |
| 1648 | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1649 As this is the internal character representation, the format is |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1650 usually not used externally (i.e. in a file or in a data sent to a |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1651 process). But, it is possible to have a text externally in this |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1652 format (i.e. by encoding by the coding system `emacs-mule'). |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1653 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1654 In that case, a sequence of one-byte codes has a slightly different |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1655 form. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1656 |
| 88365 | 1657 At first, all characters in eight-bit-control are represented by |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1658 one-byte sequences which are their 8-bit code. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1659 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1660 Next, character composition data are represented by the byte |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1661 sequence of the form: 0x80 METHOD BYTES CHARS COMPONENT ..., |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1662 where, |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1663 METHOD is 0xF0 plus one of composition method (enum |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1664 composition_method), |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1665 |
| 88365 | 1666 BYTES is 0xA0 plus a byte length of this composition data, |
| 1667 | |
| 1668 CHARS is 0x20 plus a number of characters composed by this | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1669 data, |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1670 |
| 88365 | 1671 COMPONENTs are characters of multibye form or composition |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1672 rules encoded by two-byte of ASCII codes. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1673 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1674 In addition, for backward compatibility, the following formats are |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1675 also recognized as composition data on decoding. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1676 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1677 0x80 MSEQ ... |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1678 0x80 0xFF MSEQ RULE MSEQ RULE ... MSEQ |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1679 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1680 Here, |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1681 MSEQ is a multibyte form but in these special format: |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1682 ASCII: 0xA0 ASCII_CODE+0x80, |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1683 other: LEADING_CODE+0x20 FOLLOWING-BYTE ..., |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1684 RULE is a one byte code of the range 0xA0..0xF0 that |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1685 represents a composition rule. |
| 17052 | 1686 */ |
| 1687 | |
| 88365 | 1688 char emacs_mule_bytes[256]; |
| 1689 | |
| 1690 int | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1691 emacs_mule_char (coding, src, nbytes, nchars, id) |
| 88365 | 1692 struct coding_system *coding; |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1693 const unsigned char *src; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1694 int *nbytes, *nchars, *id; |
| 88365 | 1695 { |
| 89483 | 1696 const unsigned char *src_end = coding->source + coding->src_bytes; |
| 1697 const unsigned char *src_base = src; | |
| 88365 | 1698 int multibytep = coding->src_multibyte; |
| 1699 struct charset *charset; | |
| 1700 unsigned code; | |
| 1701 int c; | |
| 1702 int consumed_chars = 0; | |
| 1703 | |
| 1704 ONE_MORE_BYTE (c); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1705 if (c < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1706 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1707 c = -c; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1708 charset = emacs_mule_charset[0]; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1709 } |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1710 else |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1711 { |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
1712 if (c >= 0xA0) |
|
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
1713 { |
|
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
1714 /* Old style component character of a compostion. */ |
|
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
1715 if (c == 0xA0) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1716 { |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
1717 ONE_MORE_BYTE (c); |
|
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
1718 c -= 0x80; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1719 } |
| 17052 | 1720 else |
| 1721 c -= 0x20; | |
| 1722 } | |
| 1723 | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1724 switch (emacs_mule_bytes[c]) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1725 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1726 case 2: |
| 88365 | 1727 if (! (charset = emacs_mule_charset[c])) |
| 1728 goto invalid_code; | |
| 1729 ONE_MORE_BYTE (c); | |
| 17052 | 1730 if (c < 0xA0) |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1731 goto invalid_code; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1732 code = c & 0x7F; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1733 break; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1734 |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1735 case 3: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1736 if (c == EMACS_MULE_LEADING_CODE_PRIVATE_11 |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1737 || c == EMACS_MULE_LEADING_CODE_PRIVATE_12) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1738 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1739 ONE_MORE_BYTE (c); |
| 89892 | 1740 if (c < 0xA0 || ! (charset = emacs_mule_charset[c])) |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1741 goto invalid_code; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1742 ONE_MORE_BYTE (c); |
| 89892 | 1743 if (c < 0xA0) |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1744 goto invalid_code; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1745 code = c & 0x7F; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1746 } |
| 26847 | 1747 else |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1748 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1749 if (! (charset = emacs_mule_charset[c])) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1750 goto invalid_code; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1751 ONE_MORE_BYTE (c); |
| 89892 | 1752 if (c < 0xA0) |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1753 goto invalid_code; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1754 code = (c & 0x7F) << 8; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1755 ONE_MORE_BYTE (c); |
| 89892 | 1756 if (c < 0xA0) |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1757 goto invalid_code; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1758 code |= c & 0x7F; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1759 } |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1760 break; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1761 |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1762 case 4: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1763 ONE_MORE_BYTE (c); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1764 if (c < 0 || ! (charset = emacs_mule_charset[c])) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1765 goto invalid_code; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1766 ONE_MORE_BYTE (c); |
| 89892 | 1767 if (c < 0xA0) |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1768 goto invalid_code; |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1769 code = (c & 0x7F) << 8; |
| 88365 | 1770 ONE_MORE_BYTE (c); |
| 89892 | 1771 if (c < 0xA0) |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1772 goto invalid_code; |
| 88365 | 1773 code |= c & 0x7F; |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1774 break; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1775 |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1776 case 1: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1777 code = c; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1778 charset = CHARSET_FROM_ID (ASCII_BYTE_P (code) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1779 ? charset_ascii : charset_eight_bit); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1780 break; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1781 |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1782 default: |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1783 abort (); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1784 } |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1785 c = DECODE_CHAR (charset, code); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1786 if (c < 0) |
| 88365 | 1787 goto invalid_code; |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1788 } |
| 88365 | 1789 *nbytes = src - src_base; |
| 1790 *nchars = consumed_chars; | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1791 if (id) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1792 *id = charset->id; |
| 88365 | 1793 return c; |
| 1794 | |
| 1795 no_more_source: | |
| 1796 return -2; | |
| 1797 | |
| 1798 invalid_code: | |
| 1799 return -1; | |
| 1800 } | |
| 1801 | |
| 17052 | 1802 |
| 1803 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1804 Check if a text is encoded in `emacs-mule'. If it is, return 1, |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1805 else return 0. */ |
| 17052 | 1806 |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
1807 static int |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1808 detect_coding_emacs_mule (coding, detect_info) |
| 88365 | 1809 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1810 struct coding_detection_info *detect_info; |
| 17052 | 1811 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1812 const unsigned char *src = coding->source, *src_base; |
| 89483 | 1813 const unsigned char *src_end = coding->source + coding->src_bytes; |
| 88365 | 1814 int multibytep = coding->src_multibyte; |
| 1815 int consumed_chars = 0; | |
| 1816 int c; | |
| 1817 int found = 0; | |
| 1818 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1819 detect_info->checked |= CATEGORY_MASK_EMACS_MULE; |
| 88365 | 1820 /* A coding system of this category is always ASCII compatible. */ |
| 1821 src += coding->head_ascii; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1822 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1823 while (1) |
| 17052 | 1824 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1825 src_base = src; |
| 88365 | 1826 ONE_MORE_BYTE (c); |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1827 if (c < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1828 continue; |
| 88365 | 1829 if (c == 0x80) |
| 17052 | 1830 { |
| 88365 | 1831 /* Perhaps the start of composite character. We simple skip |
| 1832 it because analyzing it is too heavy for detecting. But, | |
| 1833 at least, we check that the composite character | |
| 1834 constitues of more than 4 bytes. */ | |
| 89483 | 1835 const unsigned char *src_base; |
| 88365 | 1836 |
| 1837 repeat: | |
| 1838 src_base = src; | |
| 1839 do | |
| 1840 { | |
| 1841 ONE_MORE_BYTE (c); | |
| 1842 } | |
| 1843 while (c >= 0xA0); | |
| 1844 | |
| 1845 if (src - src_base <= 4) | |
| 1846 break; | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1847 found = CATEGORY_MASK_EMACS_MULE; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1848 if (c == 0x80) |
| 88365 | 1849 goto repeat; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1850 } |
| 88365 | 1851 |
| 1852 if (c < 0x80) | |
| 1853 { | |
| 1854 if (c < 0x20 | |
| 1855 && (c == ISO_CODE_ESC || c == ISO_CODE_SI || c == ISO_CODE_SO)) | |
| 1856 break; | |
| 1857 } | |
| 1858 else | |
| 1859 { | |
|
89848
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1860 int more_bytes = emacs_mule_bytes[*src_base] - 1; |
|
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1861 |
|
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1862 while (more_bytes > 0) |
| 88365 | 1863 { |
| 1864 ONE_MORE_BYTE (c); | |
|
89848
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1865 if (c < 0xA0) |
|
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1866 { |
|
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1867 src--; /* Unread the last byte. */ |
|
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1868 break; |
|
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1869 } |
|
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1870 more_bytes--; |
| 88365 | 1871 } |
|
89848
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
1872 if (more_bytes != 0) |
| 88365 | 1873 break; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1874 found = CATEGORY_MASK_EMACS_MULE; |
| 88365 | 1875 } |
| 1876 } | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1877 detect_info->rejected |= CATEGORY_MASK_EMACS_MULE; |
| 88365 | 1878 return 0; |
| 1879 | |
| 1880 no_more_source: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1881 if (src_base < src && coding->mode & CODING_MODE_LAST_BLOCK) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1882 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1883 detect_info->rejected |= CATEGORY_MASK_EMACS_MULE; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1884 return 0; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1885 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1886 detect_info->found |= found; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1887 return 1; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1888 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1889 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1890 |
| 88365 | 1891 /* See the above "GENERAL NOTES on `decode_coding_XXX ()' functions". */ |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1892 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1893 /* Decode a character represented as a component of composition |
| 88365 | 1894 sequence of Emacs 20/21 style at SRC. Set C to that character and |
| 1895 update SRC to the head of next character (or an encoded composition | |
| 1896 rule). If SRC doesn't points a composition component, set C to -1. | |
| 1897 If SRC points an invalid byte sequence, global exit by a return | |
| 1898 value 0. */ | |
| 1899 | |
| 1900 #define DECODE_EMACS_MULE_COMPOSITION_CHAR(buf) \ | |
| 1901 if (1) \ | |
| 1902 { \ | |
| 1903 int c; \ | |
| 1904 int nbytes, nchars; \ | |
|
51356
8da3b8a0ca4f
(DECODE_EMACS_MULE_COMPOSITION_CHAR): If coding->flags
Kenichi Handa <handa@m17n.org>
parents:
51327
diff
changeset
|
1905 \ |
| 88365 | 1906 if (src == src_end) \ |
| 1907 break; \ | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
1908 c = emacs_mule_char (coding, src, &nbytes, &nchars, NULL);\ |
| 88365 | 1909 if (c < 0) \ |
| 1910 { \ | |
| 1911 if (c == -2) \ | |
| 1912 break; \ | |
| 1913 goto invalid_code; \ | |
| 1914 } \ | |
| 1915 *buf++ = c; \ | |
| 1916 src += nbytes; \ | |
| 1917 consumed_chars += nchars; \ | |
| 1918 } \ | |
| 1919 else | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1920 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1921 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1922 /* Decode a composition rule represented as a component of composition |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1923 sequence of Emacs 20 style at SRC. Store the decoded rule in *BUF, |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1924 and increment BUF. If SRC points an invalid byte sequence, set C |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1925 to -1. */ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1926 |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1927 #define DECODE_EMACS_MULE_COMPOSITION_RULE_20(buf) \ |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1928 do { \ |
| 88365 | 1929 int c, gref, nref; \ |
| 1930 \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1931 if (src >= src_end) \ |
| 88365 | 1932 goto invalid_code; \ |
| 1933 ONE_MORE_BYTE_NO_CHECK (c); \ | |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
1934 c -= 0xA0; \ |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1935 if (c < 0 || c >= 81) \ |
| 88365 | 1936 goto invalid_code; \ |
| 1937 \ | |
| 1938 gref = c / 9, nref = c % 9; \ | |
| 1939 *buf++ = COMPOSITION_ENCODE_RULE (gref, nref); \ | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1940 } while (0) |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1941 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1942 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1943 /* Decode a composition rule represented as a component of composition |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1944 sequence of Emacs 21 style at SRC. Store the decoded rule in *BUF, |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1945 and increment BUF. If SRC points an invalid byte sequence, set C |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1946 to -1. */ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1947 |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1948 #define DECODE_EMACS_MULE_COMPOSITION_RULE_21(buf) \ |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1949 do { \ |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1950 int gref, nref; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1951 \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1952 if (src + 1>= src_end) \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1953 goto invalid_code; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1954 ONE_MORE_BYTE_NO_CHECK (gref); \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1955 gref -= 0x20; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1956 ONE_MORE_BYTE_NO_CHECK (nref); \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1957 nref -= 0x20; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1958 if (gref < 0 || gref >= 81 \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1959 || nref < 0 || nref >= 81) \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1960 goto invalid_code; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1961 *buf++ = COMPOSITION_ENCODE_RULE (gref, nref); \ |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1962 } while (0) |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1963 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1964 |
| 88365 | 1965 #define DECODE_EMACS_MULE_21_COMPOSITION(c) \ |
| 1966 do { \ | |
| 1967 /* Emacs 21 style format. The first three bytes at SRC are \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1968 (METHOD - 0xF2), (BYTES - 0xA0), (CHARS - 0xA0), where BYTES is \ |
| 88365 | 1969 the byte length of this composition information, CHARS is the \ |
| 1970 number of characters composed by this composition. */ \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1971 enum composition_method method = c - 0xF2; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1972 int *charbuf_base = charbuf; \ |
| 88365 | 1973 int consumed_chars_limit; \ |
| 1974 int nbytes, nchars; \ | |
| 1975 \ | |
| 1976 ONE_MORE_BYTE (c); \ | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1977 if (c < 0) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1978 goto invalid_code; \ |
| 88365 | 1979 nbytes = c - 0xA0; \ |
| 1980 if (nbytes < 3) \ | |
| 1981 goto invalid_code; \ | |
| 1982 ONE_MORE_BYTE (c); \ | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1983 if (c < 0) \ |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
1984 goto invalid_code; \ |
| 88365 | 1985 nchars = c - 0xA0; \ |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
1986 ADD_COMPOSITION_DATA (charbuf, nchars, method); \ |
| 88365 | 1987 consumed_chars_limit = consumed_chars_base + nbytes; \ |
| 1988 if (method != COMPOSITION_RELATIVE) \ | |
| 1989 { \ | |
| 1990 int i = 0; \ | |
| 1991 while (consumed_chars < consumed_chars_limit) \ | |
| 1992 { \ | |
| 1993 if (i % 2 && method != COMPOSITION_WITH_ALTCHARS) \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1994 DECODE_EMACS_MULE_COMPOSITION_RULE_21 (charbuf); \ |
| 88365 | 1995 else \ |
| 1996 DECODE_EMACS_MULE_COMPOSITION_CHAR (charbuf); \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1997 i++; \ |
| 88365 | 1998 } \ |
| 1999 if (consumed_chars < consumed_chars_limit) \ | |
| 2000 goto invalid_code; \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2001 charbuf_base[0] -= i; \ |
| 88365 | 2002 } \ |
| 2003 } while (0) | |
| 2004 | |
| 2005 | |
|
90363
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2006 #define DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION(c) \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2007 do { \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2008 /* Emacs 20 style format for relative composition. */ \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2009 /* Store multibyte form of characters to be composed. */ \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2010 enum composition_method method = COMPOSITION_RELATIVE; \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2011 int components[MAX_COMPOSITION_COMPONENTS * 2 - 1]; \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2012 int *buf = components; \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2013 int i, j; \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2014 \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2015 src = src_base; \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2016 ONE_MORE_BYTE (c); /* skip 0x80 */ \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2017 for (i = 0; *src >= 0xA0 && i < MAX_COMPOSITION_COMPONENTS; i++) \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2018 DECODE_EMACS_MULE_COMPOSITION_CHAR (buf); \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2019 if (i < 2) \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2020 goto invalid_code; \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2021 ADD_COMPOSITION_DATA (charbuf, i, method); \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2022 for (j = 0; j < i; j++) \ |
|
ec0a46fadd7e
(DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION): Fix
Kenichi Handa <handa@m17n.org>
parents:
90359
diff
changeset
|
2023 *charbuf++ = components[j]; \ |
| 88365 | 2024 } while (0) |
| 2025 | |
| 2026 | |
| 2027 #define DECODE_EMACS_MULE_20_RULEBASE_COMPOSITION(c) \ | |
| 2028 do { \ | |
| 2029 /* Emacs 20 style format for rule-base composition. */ \ | |
| 2030 /* Store multibyte form of characters to be composed. */ \ | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2031 enum composition_method method = COMPOSITION_WITH_RULE; \ |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2032 int *charbuf_base = charbuf; \ |
| 88365 | 2033 int components[MAX_COMPOSITION_COMPONENTS * 2 - 1]; \ |
| 2034 int *buf = components; \ | |
| 2035 int i, j; \ | |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2036 \ |
| 88365 | 2037 DECODE_EMACS_MULE_COMPOSITION_CHAR (buf); \ |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2038 for (i = 1; i < MAX_COMPOSITION_COMPONENTS; i++) \ |
| 88365 | 2039 { \ |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2040 if (*src < 0xA0) \ |
|
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2041 break; \ |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2042 DECODE_EMACS_MULE_COMPOSITION_RULE_20 (buf); \ |
| 88365 | 2043 DECODE_EMACS_MULE_COMPOSITION_CHAR (buf); \ |
| 2044 } \ | |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2045 if (i <= 1 || (buf - components) % 2 == 0) \ |
| 88365 | 2046 goto invalid_code; \ |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2047 if (charbuf + i + (i / 2) + 1 >= charbuf_end) \ |
| 88365 | 2048 goto no_more_source; \ |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2049 ADD_COMPOSITION_DATA (charbuf, i, method); \ |
|
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2050 i = i * 2 - 1; \ |
| 88365 | 2051 for (j = 0; j < i; j++) \ |
| 2052 *charbuf++ = components[j]; \ | |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2053 charbuf_base[0] -= i; \ |
| 88365 | 2054 for (j = 0; j < i; j += 2) \ |
| 2055 *charbuf++ = components[j]; \ | |
| 2056 } while (0) | |
| 2057 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2058 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2059 static void |
| 88365 | 2060 decode_coding_emacs_mule (coding) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2061 struct coding_system *coding; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2062 { |
| 89483 | 2063 const unsigned char *src = coding->source + coding->consumed; |
| 2064 const unsigned char *src_end = coding->source + coding->src_bytes; | |
|
59168
0345f2b10f1d
(decode_coding_XXX, decode_composition_emacs_mule)
Dan Nicolaescu <dann@ics.uci.edu>
parents:
59095
diff
changeset
|
2065 const unsigned char *src_base; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
2066 int *charbuf = coding->charbuf + coding->charbuf_used; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
2067 int *charbuf_end |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
2068 = coding->charbuf + coding->charbuf_size - MAX_ANNOTATION_LENGTH; |
| 88365 | 2069 int consumed_chars = 0, consumed_chars_base; |
| 2070 int multibytep = coding->src_multibyte; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
2071 Lisp_Object attrs, charset_list; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2072 int char_offset = coding->produced_char; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2073 int last_offset = char_offset; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2074 int last_id = charset_ascii; |
| 88365 | 2075 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
2076 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 2077 |
| 2078 while (1) | |
| 2079 { | |
| 2080 int c; | |
| 2081 | |
| 2082 src_base = src; | |
| 2083 consumed_chars_base = consumed_chars; | |
| 2084 | |
| 2085 if (charbuf >= charbuf_end) | |
| 2086 break; | |
| 2087 | |
| 2088 ONE_MORE_BYTE (c); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2089 if (c < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2090 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2091 *charbuf++ = -c; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2092 char_offset++; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2093 } |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2094 else if (c < 0x80) |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2095 { |
| 88365 | 2096 *charbuf++ = c; |
| 2097 char_offset++; | |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2098 } |
| 88365 | 2099 else if (c == 0x80) |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2100 { |
| 88365 | 2101 ONE_MORE_BYTE (c); |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2102 if (c < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2103 goto invalid_code; |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2104 if (c - 0xF2 >= COMPOSITION_RELATIVE |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2105 && c - 0xF2 <= COMPOSITION_WITH_RULE_ALTCHARS) |
| 88365 | 2106 DECODE_EMACS_MULE_21_COMPOSITION (c); |
| 2107 else if (c < 0xC0) | |
| 2108 DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION (c); | |
| 2109 else if (c == 0xFF) | |
| 2110 DECODE_EMACS_MULE_20_RULEBASE_COMPOSITION (c); | |
| 2111 else | |
| 2112 goto invalid_code; | |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2113 } |
| 88365 | 2114 else if (c < 0xA0 && emacs_mule_bytes[c] > 1) |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2115 { |
| 88365 | 2116 int nbytes, nchars; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2117 int id; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2118 |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2119 src = src_base; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2120 consumed_chars = consumed_chars_base; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2121 c = emacs_mule_char (coding, src, &nbytes, &nchars, &id); |
| 88365 | 2122 if (c < 0) |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2123 { |
| 88365 | 2124 if (c == -2) |
| 2125 break; | |
| 2126 goto invalid_code; | |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2127 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2128 if (last_id != id) |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2129 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2130 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
2131 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2132 last_id = id; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2133 last_offset = char_offset; |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2134 } |
| 88365 | 2135 *charbuf++ = c; |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2136 src += nbytes; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2137 consumed_chars += nchars; |
| 88365 | 2138 char_offset++; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2139 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2140 else |
|
90354
450fb16a4bf4
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90350
diff
changeset
|
2141 goto invalid_code; |
| 88365 | 2142 continue; |
| 2143 | |
| 2144 invalid_code: | |
| 2145 src = src_base; | |
| 2146 consumed_chars = consumed_chars_base; | |
| 2147 ONE_MORE_BYTE (c); | |
| 2148 *charbuf++ = ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2149 char_offset++; |
| 88365 | 2150 coding->errors++; |
| 2151 } | |
| 2152 | |
| 2153 no_more_source: | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2154 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
2155 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
| 88365 | 2156 coding->consumed_char += consumed_chars_base; |
| 2157 coding->consumed = src_base - coding->source; | |
| 2158 coding->charbuf_used = charbuf - coding->charbuf; | |
| 2159 } | |
| 2160 | |
| 2161 | |
| 2162 #define EMACS_MULE_LEADING_CODES(id, codes) \ | |
| 2163 do { \ | |
| 2164 if (id < 0xA0) \ | |
| 2165 codes[0] = id, codes[1] = 0; \ | |
| 2166 else if (id < 0xE0) \ | |
| 2167 codes[0] = 0x9A, codes[1] = id; \ | |
| 2168 else if (id < 0xF0) \ | |
| 2169 codes[0] = 0x9B, codes[1] = id; \ | |
| 2170 else if (id < 0xF5) \ | |
| 2171 codes[0] = 0x9C, codes[1] = id; \ | |
| 2172 else \ | |
| 2173 codes[0] = 0x9D, codes[1] = id; \ | |
| 2174 } while (0); | |
| 2175 | |
| 2176 | |
| 2177 static int | |
| 2178 encode_coding_emacs_mule (coding) | |
| 2179 struct coding_system *coding; | |
| 2180 { | |
| 2181 int multibytep = coding->dst_multibyte; | |
| 2182 int *charbuf = coding->charbuf; | |
| 2183 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 2184 unsigned char *dst = coding->destination + coding->produced; | |
| 2185 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 2186 int safe_room = 8; | |
| 2187 int produced_chars = 0; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
2188 Lisp_Object attrs, charset_list; |
| 88365 | 2189 int c; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2190 int preferred_charset_id = -1; |
| 88365 | 2191 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
2192 CODING_GET_INFO (coding, attrs, charset_list); |
|
89644
fc9cda144ffc
(encode_coding_emacs_mule): Resync charset_list to
Kenichi Handa <handa@m17n.org>
parents:
89642
diff
changeset
|
2193 if (! EQ (charset_list, Vemacs_mule_charset_list)) |
|
fc9cda144ffc
(encode_coding_emacs_mule): Resync charset_list to
Kenichi Handa <handa@m17n.org>
parents:
89642
diff
changeset
|
2194 { |
|
fc9cda144ffc
(encode_coding_emacs_mule): Resync charset_list to
Kenichi Handa <handa@m17n.org>
parents:
89642
diff
changeset
|
2195 CODING_ATTR_CHARSET_LIST (attrs) |
|
fc9cda144ffc
(encode_coding_emacs_mule): Resync charset_list to
Kenichi Handa <handa@m17n.org>
parents:
89642
diff
changeset
|
2196 = charset_list = Vemacs_mule_charset_list; |
|
fc9cda144ffc
(encode_coding_emacs_mule): Resync charset_list to
Kenichi Handa <handa@m17n.org>
parents:
89642
diff
changeset
|
2197 } |
| 88365 | 2198 |
| 2199 while (charbuf < charbuf_end) | |
| 2200 { | |
| 2201 ASSURE_DESTINATION (safe_room); | |
| 2202 c = *charbuf++; | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2203 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2204 if (c < 0) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2205 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2206 /* Handle an annotation. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2207 switch (*charbuf) |
|
54320
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2208 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2209 case CODING_ANNOTATE_COMPOSITION_MASK: |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2210 /* Not yet implemented. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2211 break; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2212 case CODING_ANNOTATE_CHARSET_MASK: |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2213 preferred_charset_id = charbuf[3]; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2214 if (preferred_charset_id >= 0 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2215 && NILP (Fmemq (make_number (preferred_charset_id), |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2216 charset_list))) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2217 preferred_charset_id = -1; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2218 break; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2219 default: |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2220 abort (); |
|
54320
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2221 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2222 charbuf += -c - 1; |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2223 continue; |
|
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
2224 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2225 |
| 88365 | 2226 if (ASCII_CHAR_P (c)) |
| 2227 EMIT_ONE_ASCII_BYTE (c); | |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
2228 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
2229 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
2230 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
2231 EMIT_ONE_BYTE (c); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2232 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2233 else |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2234 { |
| 88365 | 2235 struct charset *charset; |
| 2236 unsigned code; | |
| 2237 int dimension; | |
| 2238 int emacs_mule_id; | |
| 2239 unsigned char leading_codes[2]; | |
| 2240 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2241 if (preferred_charset_id >= 0) |
|
54320
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2242 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2243 charset = CHARSET_FROM_ID (preferred_charset_id); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2244 if (! CHAR_CHARSET_P (c, charset)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2245 charset = char_charset (c, charset_list, NULL); |
|
54320
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2246 } |
|
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2247 else |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2248 charset = char_charset (c, charset_list, &code); |
| 88365 | 2249 if (! charset) |
|
54320
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2250 { |
| 88365 | 2251 c = coding->default_char; |
| 2252 if (ASCII_CHAR_P (c)) | |
| 2253 { | |
| 2254 EMIT_ONE_ASCII_BYTE (c); | |
| 2255 continue; | |
| 2256 } | |
| 2257 charset = char_charset (c, charset_list, &code); | |
|
54320
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2258 } |
| 88365 | 2259 dimension = CHARSET_DIMENSION (charset); |
| 2260 emacs_mule_id = CHARSET_EMACS_MULE_ID (charset); | |
| 2261 EMACS_MULE_LEADING_CODES (emacs_mule_id, leading_codes); | |
| 2262 EMIT_ONE_BYTE (leading_codes[0]); | |
| 2263 if (leading_codes[1]) | |
| 2264 EMIT_ONE_BYTE (leading_codes[1]); | |
| 2265 if (dimension == 1) | |
|
89642
e97441b6244b
(encode_coding_emacs_mule): Emit bytes with MSB.
Kenichi Handa <handa@m17n.org>
parents:
89575
diff
changeset
|
2266 EMIT_ONE_BYTE (code | 0x80); |
|
54320
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2267 else |
|
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2268 { |
|
89642
e97441b6244b
(encode_coding_emacs_mule): Emit bytes with MSB.
Kenichi Handa <handa@m17n.org>
parents:
89575
diff
changeset
|
2269 code |= 0x8080; |
| 88365 | 2270 EMIT_ONE_BYTE (code >> 8); |
| 2271 EMIT_ONE_BYTE (code & 0xFF); | |
|
54320
a7e59b39de35
(decode_coding_emacs_mule): Handle insufficent source correctly.
Kenichi Handa <handa@m17n.org>
parents:
54303
diff
changeset
|
2272 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2273 } |
| 88365 | 2274 } |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2275 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 2276 coding->produced_char += produced_chars; |
| 2277 coding->produced = dst - coding->destination; | |
| 2278 return 0; | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2279 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2280 |
| 17052 | 2281 |
| 88365 | 2282 /*** 7. ISO2022 handlers ***/ |
| 17052 | 2283 |
| 2284 /* The following note describes the coding system ISO2022 briefly. | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2285 Since the intention of this note is to help understand the |
| 35053 | 2286 functions in this file, some parts are NOT ACCURATE or are OVERLY |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2287 SIMPLIFIED. For thorough understanding, please refer to the |
| 35053 | 2288 original document of ISO2022. This is equivalent to the standard |
| 2289 ECMA-35, obtainable from <URL:http://www.ecma.ch/> (*). | |
| 17052 | 2290 |
| 2291 ISO2022 provides many mechanisms to encode several character sets | |
| 35053 | 2292 in 7-bit and 8-bit environments. For 7-bit environments, all text |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2293 is encoded using bytes less than 128. This may make the encoded |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2294 text a little bit longer, but the text passes more easily through |
| 35053 | 2295 several types of gateway, some of which strip off the MSB (Most |
| 36087 | 2296 Significant Bit). |
| 35053 | 2297 |
| 2298 There are two kinds of character sets: control character sets and | |
| 2299 graphic character sets. The former contain control characters such | |
| 17052 | 2300 as `newline' and `escape' to provide control functions (control |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2301 functions are also provided by escape sequences). The latter |
| 35053 | 2302 contain graphic characters such as 'A' and '-'. Emacs recognizes |
| 17052 | 2303 two control character sets and many graphic character sets. |
| 2304 | |
| 2305 Graphic character sets are classified into one of the following | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2306 four classes, according to the number of bytes (DIMENSION) and |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2307 number of characters in one dimension (CHARS) of the set: |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2308 - DIMENSION1_CHARS94 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2309 - DIMENSION1_CHARS96 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2310 - DIMENSION2_CHARS94 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2311 - DIMENSION2_CHARS96 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2312 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2313 In addition, each character set is assigned an identification tag, |
| 35053 | 2314 unique for each set, called the "final character" (denoted as <F> |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2315 hereafter). The <F> of each character set is decided by ECMA(*) |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2316 when it is registered in ISO. The code range of <F> is 0x30..0x7F |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2317 (0x30..0x3F are for private use only). |
| 17052 | 2318 |
| 2319 Note (*): ECMA = European Computer Manufacturers Association | |
| 2320 | |
| 35053 | 2321 Here are examples of graphic character sets [NAME(<F>)]: |
| 17052 | 2322 o DIMENSION1_CHARS94 -- ASCII('B'), right-half-of-JISX0201('I'), ... |
| 2323 o DIMENSION1_CHARS96 -- right-half-of-ISO8859-1('A'), ... | |
| 2324 o DIMENSION2_CHARS94 -- GB2312('A'), JISX0208('B'), ... | |
| 2325 o DIMENSION2_CHARS96 -- none for the moment | |
| 2326 | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2327 A code area (1 byte=8 bits) is divided into 4 areas, C0, GL, C1, and GR. |
| 17052 | 2328 C0 [0x00..0x1F] -- control character plane 0 |
| 2329 GL [0x20..0x7F] -- graphic character plane 0 | |
| 2330 C1 [0x80..0x9F] -- control character plane 1 | |
| 2331 GR [0xA0..0xFF] -- graphic character plane 1 | |
| 2332 | |
| 2333 A control character set is directly designated and invoked to C0 or | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2334 C1 by an escape sequence. The most common case is that: |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2335 - ISO646's control character set is designated/invoked to C0, and |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2336 - ISO6429's control character set is designated/invoked to C1, |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2337 and usually these designations/invocations are omitted in encoded |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2338 text. In a 7-bit environment, only C0 can be used, and a control |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2339 character for C1 is encoded by an appropriate escape sequence to |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2340 fit into the environment. All control characters for C1 are |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2341 defined to have corresponding escape sequences. |
| 17052 | 2342 |
| 2343 A graphic character set is at first designated to one of four | |
| 2344 graphic registers (G0 through G3), then these graphic registers are | |
| 2345 invoked to GL or GR. These designations and invocations can be | |
| 2346 done independently. The most common case is that G0 is invoked to | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2347 GL, G1 is invoked to GR, and ASCII is designated to G0. Usually |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2348 these invocations and designations are omitted in encoded text. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2349 In a 7-bit environment, only GL can be used. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2350 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2351 When a graphic character set of CHARS94 is invoked to GL, codes |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2352 0x20 and 0x7F of the GL area work as control characters SPACE and |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2353 DEL respectively, and codes 0xA0 and 0xFF of the GR area should not |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2354 be used. |
| 17052 | 2355 |
| 2356 There are two ways of invocation: locking-shift and single-shift. | |
| 2357 With locking-shift, the invocation lasts until the next different | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2358 invocation, whereas with single-shift, the invocation affects the |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2359 following character only and doesn't affect the locking-shift |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2360 state. Invocations are done by the following control characters or |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2361 escape sequences: |
| 17052 | 2362 |
| 2363 ---------------------------------------------------------------------- | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2364 abbrev function cntrl escape seq description |
| 17052 | 2365 ---------------------------------------------------------------------- |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2366 SI/LS0 (shift-in) 0x0F none invoke G0 into GL |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2367 SO/LS1 (shift-out) 0x0E none invoke G1 into GL |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2368 LS2 (locking-shift-2) none ESC 'n' invoke G2 into GL |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2369 LS3 (locking-shift-3) none ESC 'o' invoke G3 into GL |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2370 LS1R (locking-shift-1 right) none ESC '~' invoke G1 into GR (*) |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2371 LS2R (locking-shift-2 right) none ESC '}' invoke G2 into GR (*) |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2372 LS3R (locking-shift 3 right) none ESC '|' invoke G3 into GR (*) |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2373 SS2 (single-shift-2) 0x8E ESC 'N' invoke G2 for one char |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2374 SS3 (single-shift-3) 0x8F ESC 'O' invoke G3 for one char |
| 17052 | 2375 ---------------------------------------------------------------------- |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2376 (*) These are not used by any known coding system. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2377 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2378 Control characters for these functions are defined by macros |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2379 ISO_CODE_XXX in `coding.h'. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2380 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2381 Designations are done by the following escape sequences: |
| 17052 | 2382 ---------------------------------------------------------------------- |
| 2383 escape sequence description | |
| 2384 ---------------------------------------------------------------------- | |
| 2385 ESC '(' <F> designate DIMENSION1_CHARS94<F> to G0 | |
| 2386 ESC ')' <F> designate DIMENSION1_CHARS94<F> to G1 | |
| 2387 ESC '*' <F> designate DIMENSION1_CHARS94<F> to G2 | |
| 2388 ESC '+' <F> designate DIMENSION1_CHARS94<F> to G3 | |
| 2389 ESC ',' <F> designate DIMENSION1_CHARS96<F> to G0 (*) | |
| 2390 ESC '-' <F> designate DIMENSION1_CHARS96<F> to G1 | |
| 2391 ESC '.' <F> designate DIMENSION1_CHARS96<F> to G2 | |
| 2392 ESC '/' <F> designate DIMENSION1_CHARS96<F> to G3 | |
| 2393 ESC '$' '(' <F> designate DIMENSION2_CHARS94<F> to G0 (**) | |
| 2394 ESC '$' ')' <F> designate DIMENSION2_CHARS94<F> to G1 | |
| 2395 ESC '$' '*' <F> designate DIMENSION2_CHARS94<F> to G2 | |
| 2396 ESC '$' '+' <F> designate DIMENSION2_CHARS94<F> to G3 | |
| 2397 ESC '$' ',' <F> designate DIMENSION2_CHARS96<F> to G0 (*) | |
| 2398 ESC '$' '-' <F> designate DIMENSION2_CHARS96<F> to G1 | |
| 2399 ESC '$' '.' <F> designate DIMENSION2_CHARS96<F> to G2 | |
| 2400 ESC '$' '/' <F> designate DIMENSION2_CHARS96<F> to G3 | |
| 2401 ---------------------------------------------------------------------- | |
| 2402 | |
| 2403 In this list, "DIMENSION1_CHARS94<F>" means a graphic character set | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2404 of dimension 1, chars 94, and final character <F>, etc... |
| 17052 | 2405 |
| 2406 Note (*): Although these designations are not allowed in ISO2022, | |
| 2407 Emacs accepts them on decoding, and produces them on encoding | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2408 CHARS96 character sets in a coding system which is characterized as |
| 17052 | 2409 7-bit environment, non-locking-shift, and non-single-shift. |
| 2410 | |
| 2411 Note (**): If <F> is '@', 'A', or 'B', the intermediate character | |
| 88365 | 2412 '(' must be omitted. We refer to this as "short-form" hereafter. |
| 17052 | 2413 |
| 35053 | 2414 Now you may notice that there are a lot of ways of encoding the |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2415 same multilingual text in ISO2022. Actually, there exist many |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2416 coding systems such as Compound Text (used in X11's inter client |
| 36087 | 2417 communication, ISO-2022-JP (used in Japanese Internet), ISO-2022-KR |
| 2418 (used in Korean Internet), EUC (Extended UNIX Code, used in Asian | |
| 17052 | 2419 localized platforms), and all of these are variants of ISO2022. |
| 2420 | |
| 2421 In addition to the above, Emacs handles two more kinds of escape | |
| 2422 sequences: ISO6429's direction specification and Emacs' private | |
| 2423 sequence for specifying character composition. | |
| 2424 | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2425 ISO6429's direction specification takes the following form: |
| 17052 | 2426 o CSI ']' -- end of the current direction |
| 2427 o CSI '0' ']' -- end of the current direction | |
| 2428 o CSI '1' ']' -- start of left-to-right text | |
| 2429 o CSI '2' ']' -- start of right-to-left text | |
| 2430 The control character CSI (0x9B: control sequence introducer) is | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2431 abbreviated to the escape sequence ESC '[' in a 7-bit environment. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2432 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2433 Character composition specification takes the following form: |
| 26847 | 2434 o ESC '0' -- start relative composition |
| 2435 o ESC '1' -- end composition | |
| 2436 o ESC '2' -- start rule-base composition (*) | |
| 2437 o ESC '3' -- start relative composition with alternate chars (**) | |
| 2438 o ESC '4' -- start rule-base composition with alternate chars (**) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2439 Since these are not standard escape sequences of any ISO standard, |
| 35053 | 2440 the use of them with these meanings is restricted to Emacs only. |
| 2441 | |
| 88771 | 2442 (*) This form is used only in Emacs 20.7 and older versions, |
| 2443 but newer versions can safely decode it. | |
| 35053 | 2444 (**) This form is used only in Emacs 21.1 and newer versions, |
| 88771 | 2445 and older versions can't decode it. |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2446 |
| 35053 | 2447 Here's a list of example usages of these composition escape |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2448 sequences (categorized by `enum composition_method'). |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2449 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2450 COMPOSITION_RELATIVE: |
| 26847 | 2451 ESC 0 CHAR [ CHAR ] ESC 1 |
| 36087 | 2452 COMPOSITION_WITH_RULE: |
| 26847 | 2453 ESC 2 CHAR [ RULE CHAR ] ESC 1 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2454 COMPOSITION_WITH_ALTCHARS: |
| 26847 | 2455 ESC 3 ALTCHAR [ ALTCHAR ] ESC 0 CHAR [ CHAR ] ESC 1 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2456 COMPOSITION_WITH_RULE_ALTCHARS: |
| 26847 | 2457 ESC 4 ALTCHAR [ RULE ALTCHAR ] ESC 0 CHAR [ CHAR ] ESC 1 */ |
| 17052 | 2458 |
| 2459 enum iso_code_class_type iso_code_class[256]; | |
| 2460 | |
| 88365 | 2461 #define SAFE_CHARSET_P(coding, id) \ |
| 2462 ((id) <= (coding)->max_charset_id \ | |
| 2463 && (coding)->safe_charsets[id] >= 0) | |
| 2464 | |
| 2465 | |
| 2466 #define SHIFT_OUT_OK(category) \ | |
| 2467 (CODING_ISO_INITIAL (&coding_categories[category], 1) >= 0) | |
| 2468 | |
| 2469 static void | |
|
88631
780b91d4a7e5
(setup_iso_safe_charsets): Fix arg decl for K&R.
Dave Love <fx@gnu.org>
parents:
88607
diff
changeset
|
2470 setup_iso_safe_charsets (attrs) |
|
780b91d4a7e5
(setup_iso_safe_charsets): Fix arg decl for K&R.
Dave Love <fx@gnu.org>
parents:
88607
diff
changeset
|
2471 Lisp_Object attrs; |
| 88365 | 2472 { |
| 2473 Lisp_Object charset_list, safe_charsets; | |
| 2474 Lisp_Object request; | |
| 2475 Lisp_Object reg_usage; | |
| 2476 Lisp_Object tail; | |
| 2477 int reg94, reg96; | |
| 2478 int flags = XINT (AREF (attrs, coding_attr_iso_flags)); | |
| 2479 int max_charset_id; | |
| 2480 | |
| 2481 charset_list = CODING_ATTR_CHARSET_LIST (attrs); | |
| 2482 if ((flags & CODING_ISO_FLAG_FULL_SUPPORT) | |
| 2483 && ! EQ (charset_list, Viso_2022_charset_list)) | |
| 2484 { | |
| 2485 CODING_ATTR_CHARSET_LIST (attrs) | |
| 2486 = charset_list = Viso_2022_charset_list; | |
| 2487 ASET (attrs, coding_attr_safe_charsets, Qnil); | |
| 2488 } | |
| 2489 | |
| 2490 if (STRINGP (AREF (attrs, coding_attr_safe_charsets))) | |
| 2491 return; | |
| 2492 | |
| 2493 max_charset_id = 0; | |
| 2494 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) | |
| 2495 { | |
| 2496 int id = XINT (XCAR (tail)); | |
| 2497 if (max_charset_id < id) | |
| 2498 max_charset_id = id; | |
| 2499 } | |
| 2500 | |
| 2501 safe_charsets = Fmake_string (make_number (max_charset_id + 1), | |
| 2502 make_number (255)); | |
| 2503 request = AREF (attrs, coding_attr_iso_request); | |
| 2504 reg_usage = AREF (attrs, coding_attr_iso_usage); | |
| 2505 reg94 = XINT (XCAR (reg_usage)); | |
| 2506 reg96 = XINT (XCDR (reg_usage)); | |
| 2507 | |
| 2508 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) | |
| 2509 { | |
| 2510 Lisp_Object id; | |
| 2511 Lisp_Object reg; | |
| 2512 struct charset *charset; | |
| 2513 | |
| 2514 id = XCAR (tail); | |
| 2515 charset = CHARSET_FROM_ID (XINT (id)); | |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2516 reg = Fcdr (Fassq (id, request)); |
| 88365 | 2517 if (! NILP (reg)) |
| 89483 | 2518 SSET (safe_charsets, XINT (id), XINT (reg)); |
| 88365 | 2519 else if (charset->iso_chars_96) |
| 2520 { | |
| 2521 if (reg96 < 4) | |
| 89483 | 2522 SSET (safe_charsets, XINT (id), reg96); |
| 88365 | 2523 } |
| 2524 else | |
| 2525 { | |
| 2526 if (reg94 < 4) | |
| 89483 | 2527 SSET (safe_charsets, XINT (id), reg94); |
| 88365 | 2528 } |
| 2529 } | |
| 2530 ASET (attrs, coding_attr_safe_charsets, safe_charsets); | |
| 2531 } | |
| 2532 | |
|
50047
8e17fbb2ac77
(CODING_ADD_COMPOSITION_COMPONENT): If the number of
Kenichi Handa <handa@m17n.org>
parents:
49600
diff
changeset
|
2533 |
| 17052 | 2534 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2535 Check if a text is encoded in one of ISO-2022 based codig systems. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2536 If it is, return 1, else return 0. */ |
| 17052 | 2537 |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
2538 static int |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2539 detect_coding_iso_2022 (coding, detect_info) |
| 88365 | 2540 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2541 struct coding_detection_info *detect_info; |
| 17052 | 2542 { |
| 89483 | 2543 const unsigned char *src = coding->source, *src_base = src; |
| 2544 const unsigned char *src_end = coding->source + coding->src_bytes; | |
| 88365 | 2545 int multibytep = coding->src_multibyte; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2546 int single_shifting = 0; |
| 88365 | 2547 int id; |
| 2548 int c, c1; | |
| 2549 int consumed_chars = 0; | |
| 2550 int i; | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2551 int rejected = 0; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2552 int found = 0; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2553 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2554 detect_info->checked |= CATEGORY_MASK_ISO; |
| 88365 | 2555 |
| 2556 for (i = coding_category_iso_7; i <= coding_category_iso_8_else; i++) | |
| 2557 { | |
| 2558 struct coding_system *this = &(coding_categories[i]); | |
| 2559 Lisp_Object attrs, val; | |
| 2560 | |
| 2561 attrs = CODING_ID_ATTRS (this->id); | |
| 2562 if (CODING_ISO_FLAGS (this) & CODING_ISO_FLAG_FULL_SUPPORT | |
| 2563 && ! EQ (CODING_ATTR_SAFE_CHARSETS (attrs), Viso_2022_charset_list)) | |
| 2564 setup_iso_safe_charsets (attrs); | |
| 2565 val = CODING_ATTR_SAFE_CHARSETS (attrs); | |
| 89483 | 2566 this->max_charset_id = SCHARS (val) - 1; |
| 2567 this->safe_charsets = (char *) SDATA (val); | |
| 88365 | 2568 } |
| 2569 | |
| 2570 /* A coding system of this category is always ASCII compatible. */ | |
| 2571 src += coding->head_ascii; | |
| 2572 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2573 while (rejected != CATEGORY_MASK_ISO) |
| 88365 | 2574 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2575 src_base = src; |
| 88365 | 2576 ONE_MORE_BYTE (c); |
| 17052 | 2577 switch (c) |
| 2578 { | |
| 2579 case ISO_CODE_ESC: | |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2580 if (inhibit_iso_escape_detection) |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2581 break; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2582 single_shifting = 0; |
| 88365 | 2583 ONE_MORE_BYTE (c); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2584 if (c >= '(' && c <= '/') |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2585 { |
|
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2586 /* Designation sequence for a charset of dimension 1. */ |
| 88365 | 2587 ONE_MORE_BYTE (c1); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2588 if (c1 < ' ' || c1 >= 0x80 |
| 88365 | 2589 || (id = iso_charset_table[0][c >= ','][c1]) < 0) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2590 /* Invalid designation sequence. Just ignore. */ |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2591 break; |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2592 } |
|
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2593 else if (c == '$') |
| 17052 | 2594 { |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2595 /* Designation sequence for a charset of dimension 2. */ |
| 88365 | 2596 ONE_MORE_BYTE (c); |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2597 if (c >= '@' && c <= 'B') |
|
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2598 /* Designation for JISX0208.1978, GB2312, or JISX0208. */ |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2599 id = iso_charset_table[1][0][c]; |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2600 else if (c >= '(' && c <= '/') |
|
17320
9d15bec5f47e
(detect_coding_iso2022, detect_coding_mask): Ignore
Kenichi Handa <handa@m17n.org>
parents:
17304
diff
changeset
|
2601 { |
| 88365 | 2602 ONE_MORE_BYTE (c1); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2603 if (c1 < ' ' || c1 >= 0x80 |
| 88365 | 2604 || (id = iso_charset_table[1][c >= ','][c1]) < 0) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2605 /* Invalid designation sequence. Just ignore. */ |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2606 break; |
|
17320
9d15bec5f47e
(detect_coding_iso2022, detect_coding_mask): Ignore
Kenichi Handa <handa@m17n.org>
parents:
17304
diff
changeset
|
2607 } |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2608 else |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2609 /* Invalid designation sequence. Just ignore it. */ |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2610 break; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2611 } |
|
23116
6736da064f4a
(detect_coding_iso2022): Handle ESC N and ESC O
Kenichi Handa <handa@m17n.org>
parents:
23089
diff
changeset
|
2612 else if (c == 'N' || c == 'O') |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2613 { |
|
23116
6736da064f4a
(detect_coding_iso2022): Handle ESC N and ESC O
Kenichi Handa <handa@m17n.org>
parents:
23089
diff
changeset
|
2614 /* ESC <Fe> for SS2 or SS3. */ |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2615 single_shifting = 1; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2616 rejected |= CATEGORY_MASK_ISO_7BIT | CATEGORY_MASK_ISO_8BIT; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2617 break; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2618 } |
| 26847 | 2619 else if (c >= '0' && c <= '4') |
| 2620 { | |
| 2621 /* ESC <Fp> for start/end composition. */ | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2622 found |= CATEGORY_MASK_ISO; |
| 26847 | 2623 break; |
| 2624 } | |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2625 else |
| 88365 | 2626 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2627 /* Invalid escape sequence. Just ignore it. */ |
| 88365 | 2628 break; |
| 2629 } | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2630 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2631 /* We found a valid designation sequence for CHARSET. */ |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2632 rejected |= CATEGORY_MASK_ISO_8BIT; |
| 88365 | 2633 if (SAFE_CHARSET_P (&coding_categories[coding_category_iso_7], |
| 2634 id)) | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2635 found |= CATEGORY_MASK_ISO_7; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2636 else |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2637 rejected |= CATEGORY_MASK_ISO_7; |
| 88365 | 2638 if (SAFE_CHARSET_P (&coding_categories[coding_category_iso_7_tight], |
| 2639 id)) | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2640 found |= CATEGORY_MASK_ISO_7_TIGHT; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2641 else |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2642 rejected |= CATEGORY_MASK_ISO_7_TIGHT; |
| 88365 | 2643 if (SAFE_CHARSET_P (&coding_categories[coding_category_iso_7_else], |
| 2644 id)) | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2645 found |= CATEGORY_MASK_ISO_7_ELSE; |
|
23116
6736da064f4a
(detect_coding_iso2022): Handle ESC N and ESC O
Kenichi Handa <handa@m17n.org>
parents:
23089
diff
changeset
|
2646 else |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2647 rejected |= CATEGORY_MASK_ISO_7_ELSE; |
| 88365 | 2648 if (SAFE_CHARSET_P (&coding_categories[coding_category_iso_8_else], |
| 2649 id)) | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2650 found |= CATEGORY_MASK_ISO_8_ELSE; |
|
23116
6736da064f4a
(detect_coding_iso2022): Handle ESC N and ESC O
Kenichi Handa <handa@m17n.org>
parents:
23089
diff
changeset
|
2651 else |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2652 rejected |= CATEGORY_MASK_ISO_8_ELSE; |
| 17052 | 2653 break; |
| 2654 | |
| 2655 case ISO_CODE_SO: | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2656 case ISO_CODE_SI: |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2657 /* Locking shift out/in. */ |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2658 if (inhibit_iso_escape_detection) |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2659 break; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2660 single_shifting = 0; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2661 rejected |= CATEGORY_MASK_ISO_7BIT | CATEGORY_MASK_ISO_8BIT; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2662 break; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2663 |
| 17052 | 2664 case ISO_CODE_CSI: |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2665 /* Control sequence introducer. */ |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2666 single_shifting = 0; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2667 rejected |= CATEGORY_MASK_ISO_7BIT | CATEGORY_MASK_ISO_7_ELSE; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2668 found |= CATEGORY_MASK_ISO_8_ELSE; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2669 goto check_extra_latin; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2670 |
| 17052 | 2671 case ISO_CODE_SS2: |
| 2672 case ISO_CODE_SS3: | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2673 /* Single shift. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2674 if (inhibit_iso_escape_detection) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2675 break; |
|
89780
a53cb5864a40
(detect_coding_iso_2022): Fix handling of SS2 and SS3.
Kenichi Handa <handa@m17n.org>
parents:
89779
diff
changeset
|
2676 single_shifting = 0; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2677 rejected |= CATEGORY_MASK_ISO_7BIT; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2678 if (CODING_ISO_FLAGS (&coding_categories[coding_category_iso_8_1]) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2679 & CODING_ISO_FLAG_SINGLE_SHIFT) |
|
89780
a53cb5864a40
(detect_coding_iso_2022): Fix handling of SS2 and SS3.
Kenichi Handa <handa@m17n.org>
parents:
89779
diff
changeset
|
2680 found |= CATEGORY_MASK_ISO_8_1, single_shifting = 1; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2681 if (CODING_ISO_FLAGS (&coding_categories[coding_category_iso_8_2]) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2682 & CODING_ISO_FLAG_SINGLE_SHIFT) |
|
89780
a53cb5864a40
(detect_coding_iso_2022): Fix handling of SS2 and SS3.
Kenichi Handa <handa@m17n.org>
parents:
89779
diff
changeset
|
2683 found |= CATEGORY_MASK_ISO_8_2, single_shifting = 1; |
|
a53cb5864a40
(detect_coding_iso_2022): Fix handling of SS2 and SS3.
Kenichi Handa <handa@m17n.org>
parents:
89779
diff
changeset
|
2684 if (single_shifting) |
|
a53cb5864a40
(detect_coding_iso_2022): Fix handling of SS2 and SS3.
Kenichi Handa <handa@m17n.org>
parents:
89779
diff
changeset
|
2685 break; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2686 goto check_extra_latin; |
| 17052 | 2687 |
| 2688 default: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2689 if (c < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2690 continue; |
| 17052 | 2691 if (c < 0x80) |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2692 { |
|
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2693 single_shifting = 0; |
|
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2694 break; |
|
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2695 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2696 if (c >= 0xA0) |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
2697 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2698 rejected |= CATEGORY_MASK_ISO_7BIT | CATEGORY_MASK_ISO_7_ELSE; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2699 found |= CATEGORY_MASK_ISO_8_1; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2700 /* Check the length of succeeding codes of the range |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2701 0xA0..0FF. If the byte length is even, we include |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2702 CATEGORY_MASK_ISO_8_2 in `found'. We can check this |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2703 only when we are not single shifting. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2704 if (! single_shifting |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2705 && ! (rejected & CATEGORY_MASK_ISO_8_2)) |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2706 { |
|
29299
b33b38d81020
(detect_coding_iso2022): Fix code for checking
Kenichi Handa <handa@m17n.org>
parents:
29275
diff
changeset
|
2707 int i = 1; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2708 while (src < src_end) |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2709 { |
| 88365 | 2710 ONE_MORE_BYTE (c); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2711 if (c < 0xA0) |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2712 break; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2713 i++; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2714 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2715 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2716 if (i & 1 && src < src_end) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2717 rejected |= CATEGORY_MASK_ISO_8_2; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2718 else |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2719 found |= CATEGORY_MASK_ISO_8_2; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2720 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2721 break; |
| 17052 | 2722 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2723 check_extra_latin: |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2724 single_shifting = 0; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2725 if (! VECTORP (Vlatin_extra_code_table) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2726 || NILP (XVECTOR (Vlatin_extra_code_table)->contents[c])) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2727 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2728 rejected = CATEGORY_MASK_ISO; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2729 break; |
| 17052 | 2730 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2731 if (CODING_ISO_FLAGS (&coding_categories[coding_category_iso_8_1]) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2732 & CODING_ISO_FLAG_LATIN_EXTRA) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2733 found |= CATEGORY_MASK_ISO_8_1; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2734 else |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2735 rejected |= CATEGORY_MASK_ISO_8_1; |
|
89780
a53cb5864a40
(detect_coding_iso_2022): Fix handling of SS2 and SS3.
Kenichi Handa <handa@m17n.org>
parents:
89779
diff
changeset
|
2736 rejected |= CATEGORY_MASK_ISO_8_2; |
| 17052 | 2737 } |
| 2738 } | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2739 detect_info->rejected |= CATEGORY_MASK_ISO; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2740 return 0; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2741 |
| 88365 | 2742 no_more_source: |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2743 detect_info->rejected |= rejected; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2744 detect_info->found |= (found & ~rejected); |
| 88365 | 2745 return 1; |
| 17052 | 2746 } |
| 2747 | |
| 2748 | |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
2749 /* Set designation state into CODING. Set CHARS_96 to -1 if the |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
2750 escape sequence should be kept. */ |
| 88365 | 2751 #define DECODE_DESIGNATION(reg, dim, chars_96, final) \ |
| 2752 do { \ | |
| 2753 int id, prev; \ | |
| 2754 \ | |
| 2755 if (final < '0' || final >= 128 \ | |
| 2756 || ((id = ISO_CHARSET_TABLE (dim, chars_96, final)) < 0) \ | |
| 2757 || !SAFE_CHARSET_P (coding, id)) \ | |
| 2758 { \ | |
| 2759 CODING_ISO_DESIGNATION (coding, reg) = -2; \ | |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
2760 chars_96 = -1; \ |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
2761 break; \ |
| 88365 | 2762 } \ |
| 2763 prev = CODING_ISO_DESIGNATION (coding, reg); \ | |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2764 if (id == charset_jisx0201_roman) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2765 { \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2766 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_USE_ROMAN) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2767 id = charset_ascii; \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2768 } \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2769 else if (id == charset_jisx0208_1978) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2770 { \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2771 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_USE_OLDJIS) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2772 id = charset_jisx0208; \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2773 } \ |
| 88365 | 2774 CODING_ISO_DESIGNATION (coding, reg) = id; \ |
| 2775 /* If there was an invalid designation to REG previously, and this \ | |
| 2776 designation is ASCII to REG, we should keep this designation \ | |
| 2777 sequence. */ \ | |
| 2778 if (prev == -2 && id == charset_ascii) \ | |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
2779 chars_96 = -1; \ |
| 17052 | 2780 } while (0) |
| 2781 | |
| 88365 | 2782 |
| 2783 #define MAYBE_FINISH_COMPOSITION() \ | |
| 2784 do { \ | |
| 2785 int i; \ | |
| 2786 if (composition_state == COMPOSING_NO) \ | |
| 2787 break; \ | |
| 2788 /* It is assured that we have enough room for producing \ | |
| 2789 characters stored in the table `components'. */ \ | |
| 2790 if (charbuf + component_idx > charbuf_end) \ | |
| 2791 goto no_more_source; \ | |
| 2792 composition_state = COMPOSING_NO; \ | |
| 2793 if (method == COMPOSITION_RELATIVE \ | |
| 2794 || method == COMPOSITION_WITH_ALTCHARS) \ | |
| 2795 { \ | |
| 2796 for (i = 0; i < component_idx; i++) \ | |
| 2797 *charbuf++ = components[i]; \ | |
| 2798 char_offset += component_idx; \ | |
| 2799 } \ | |
| 2800 else \ | |
| 2801 { \ | |
| 2802 for (i = 0; i < component_idx; i += 2) \ | |
| 2803 *charbuf++ = components[i]; \ | |
| 2804 char_offset += (component_idx / 2) + 1; \ | |
| 2805 } \ | |
| 2806 } while (0) | |
| 2807 | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2808 |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2809 /* Handle composition start sequence ESC 0, ESC 2, ESC 3, or ESC 4. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2810 ESC 0 : relative composition : ESC 0 CHAR ... ESC 1 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2811 ESC 2 : rulebase composition : ESC 2 CHAR RULE CHAR RULE ... CHAR ESC 1 |
| 88365 | 2812 ESC 3 : altchar composition : ESC 3 CHAR ... ESC 0 CHAR ... ESC 1 |
| 2813 ESC 4 : alt&rule composition : ESC 4 CHAR RULE ... CHAR ESC 0 CHAR ... ESC 1 | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2814 */ |
| 26847 | 2815 |
| 88365 | 2816 #define DECODE_COMPOSITION_START(c1) \ |
| 26847 | 2817 do { \ |
| 88365 | 2818 if (c1 == '0' \ |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2819 && composition_state == COMPOSING_COMPONENT_RULE) \ |
| 26847 | 2820 { \ |
| 88365 | 2821 component_len = component_idx; \ |
| 2822 composition_state = COMPOSING_CHAR; \ | |
| 26847 | 2823 } \ |
| 2824 else \ | |
| 2825 { \ | |
| 89483 | 2826 const unsigned char *p; \ |
| 88365 | 2827 \ |
| 2828 MAYBE_FINISH_COMPOSITION (); \ | |
| 2829 if (charbuf + MAX_COMPOSITION_COMPONENTS > charbuf_end) \ | |
| 2830 goto no_more_source; \ | |
| 2831 for (p = src; p < src_end - 1; p++) \ | |
| 2832 if (*p == ISO_CODE_ESC && p[1] == '1') \ | |
| 2833 break; \ | |
| 2834 if (p == src_end - 1) \ | |
| 2835 { \ | |
|
90350
60eaefb08cf7
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90346
diff
changeset
|
2836 /* The current composition doesn't end in the current \ |
|
60eaefb08cf7
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90346
diff
changeset
|
2837 source. */ \ |
|
60eaefb08cf7
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90346
diff
changeset
|
2838 record_conversion_result \ |
|
60eaefb08cf7
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90346
diff
changeset
|
2839 (coding, CODING_RESULT_INSUFFICIENT_SRC); \ |
| 88365 | 2840 goto no_more_source; \ |
| 2841 } \ | |
| 2842 \ | |
| 2843 /* This is surely the start of a composition. */ \ | |
| 2844 method = (c1 == '0' ? COMPOSITION_RELATIVE \ | |
| 2845 : c1 == '2' ? COMPOSITION_WITH_RULE \ | |
| 2846 : c1 == '3' ? COMPOSITION_WITH_ALTCHARS \ | |
| 2847 : COMPOSITION_WITH_RULE_ALTCHARS); \ | |
| 2848 composition_state = (c1 <= '2' ? COMPOSING_CHAR \ | |
| 2849 : COMPOSING_COMPONENT_CHAR); \ | |
| 2850 component_idx = component_len = 0; \ | |
| 26847 | 2851 } \ |
| 2852 } while (0) | |
| 2853 | |
| 88365 | 2854 |
| 2855 /* Handle compositoin end sequence ESC 1. */ | |
| 2856 | |
| 2857 #define DECODE_COMPOSITION_END() \ | |
| 2858 do { \ | |
| 2859 int nchars = (component_len > 0 ? component_idx - component_len \ | |
| 2860 : method == COMPOSITION_RELATIVE ? component_idx \ | |
| 2861 : (component_idx + 1) / 2); \ | |
| 2862 int i; \ | |
| 2863 int *saved_charbuf = charbuf; \ | |
| 2864 \ | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
2865 ADD_COMPOSITION_DATA (charbuf, nchars, method); \ |
| 88365 | 2866 if (method != COMPOSITION_RELATIVE) \ |
| 2867 { \ | |
| 2868 if (component_len == 0) \ | |
| 2869 for (i = 0; i < component_idx; i++) \ | |
| 2870 *charbuf++ = components[i]; \ | |
| 2871 else \ | |
| 2872 for (i = 0; i < component_len; i++) \ | |
| 2873 *charbuf++ = components[i]; \ | |
| 2874 *saved_charbuf = saved_charbuf - charbuf; \ | |
| 2875 } \ | |
| 2876 if (method == COMPOSITION_WITH_RULE) \ | |
| 2877 for (i = 0; i < component_idx; i += 2, char_offset++) \ | |
| 2878 *charbuf++ = components[i]; \ | |
| 2879 else \ | |
| 2880 for (i = component_len; i < component_idx; i++, char_offset++) \ | |
| 2881 *charbuf++ = components[i]; \ | |
| 2882 coding->annotated = 1; \ | |
| 2883 composition_state = COMPOSING_NO; \ | |
| 2884 } while (0) | |
| 2885 | |
| 2886 | |
| 26847 | 2887 /* Decode a composition rule from the byte C1 (and maybe one more byte |
| 2888 from SRC) and store one encoded composition rule in | |
| 2889 coding->cmp_data. */ | |
| 2890 | |
| 2891 #define DECODE_COMPOSITION_RULE(c1) \ | |
| 2892 do { \ | |
| 2893 (c1) -= 32; \ | |
| 2894 if (c1 < 81) /* old format (before ver.21) */ \ | |
| 2895 { \ | |
| 2896 int gref = (c1) / 9; \ | |
| 2897 int nref = (c1) % 9; \ | |
| 2898 if (gref == 4) gref = 10; \ | |
| 2899 if (nref == 4) nref = 10; \ | |
| 88365 | 2900 c1 = COMPOSITION_ENCODE_RULE (gref, nref); \ |
| 26847 | 2901 } \ |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2902 else if (c1 < 93) /* new format (after ver.21) */ \ |
| 26847 | 2903 { \ |
| 2904 ONE_MORE_BYTE (c2); \ | |
| 88365 | 2905 c1 = COMPOSITION_ENCODE_RULE (c1 - 81, c2 - 32); \ |
| 26847 | 2906 } \ |
| 88365 | 2907 else \ |
| 2908 c1 = 0; \ | |
| 26847 | 2909 } while (0) |
| 2910 | |
| 2911 | |
| 17052 | 2912 /* See the above "GENERAL NOTES on `decode_coding_XXX ()' functions". */ |
| 2913 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2914 static void |
| 88365 | 2915 decode_coding_iso_2022 (coding) |
| 17052 | 2916 struct coding_system *coding; |
| 2917 { | |
| 89483 | 2918 const unsigned char *src = coding->source + coding->consumed; |
| 2919 const unsigned char *src_end = coding->source + coding->src_bytes; | |
| 2920 const unsigned char *src_base; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
2921 int *charbuf = coding->charbuf + coding->charbuf_used; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2922 int *charbuf_end |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
2923 = coding->charbuf + coding->charbuf_size - 4 - MAX_ANNOTATION_LENGTH; |
| 88365 | 2924 int consumed_chars = 0, consumed_chars_base; |
| 2925 int multibytep = coding->src_multibyte; | |
| 17052 | 2926 /* Charsets invoked to graphic plane 0 and 1 respectively. */ |
| 88365 | 2927 int charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); |
| 2928 int charset_id_1 = CODING_ISO_INVOKED_CHARSET (coding, 1); | |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
2929 int charset_id_2, charset_id_3; |
| 88365 | 2930 struct charset *charset; |
| 2931 int c; | |
| 2932 /* For handling composition sequence. */ | |
| 2933 #define COMPOSING_NO 0 | |
| 2934 #define COMPOSING_CHAR 1 | |
| 2935 #define COMPOSING_RULE 2 | |
| 2936 #define COMPOSING_COMPONENT_CHAR 3 | |
| 2937 #define COMPOSING_COMPONENT_RULE 4 | |
| 2938 | |
| 2939 int composition_state = COMPOSING_NO; | |
| 2940 enum composition_method method; | |
| 2941 int components[MAX_COMPOSITION_COMPONENTS * 2 + 1]; | |
| 2942 int component_idx; | |
| 2943 int component_len; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
2944 Lisp_Object attrs, charset_list; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2945 int char_offset = coding->produced_char; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2946 int last_offset = char_offset; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
2947 int last_id = charset_ascii; |
| 88365 | 2948 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
2949 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 2950 setup_iso_safe_charsets (attrs); |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
2951 /* Charset list may have been changed. */ |
|
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
2952 charset_list = CODING_ATTR_CHARSET_LIST (attrs); |
|
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
2953 coding->safe_charsets = (char *) SDATA (CODING_ATTR_SAFE_CHARSETS(attrs)); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2954 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2955 while (1) |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2956 { |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2957 int c1, c2; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2958 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2959 src_base = src; |
| 88365 | 2960 consumed_chars_base = consumed_chars; |
| 2961 | |
| 2962 if (charbuf >= charbuf_end) | |
| 2963 break; | |
| 2964 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2965 ONE_MORE_BYTE (c1); |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2966 if (c1 < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
2967 goto invalid_code; |
| 17052 | 2968 |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
2969 /* We produce at most one character. */ |
| 17052 | 2970 switch (iso_code_class [c1]) |
| 2971 { | |
| 2972 case ISO_0x20_or_0x7F: | |
| 88365 | 2973 if (composition_state != COMPOSING_NO) |
| 26847 | 2974 { |
| 88365 | 2975 if (composition_state == COMPOSING_RULE |
| 2976 || composition_state == COMPOSING_COMPONENT_RULE) | |
| 2977 { | |
| 2978 DECODE_COMPOSITION_RULE (c1); | |
| 2979 components[component_idx++] = c1; | |
| 2980 composition_state--; | |
| 2981 continue; | |
| 2982 } | |
| 26847 | 2983 } |
| 88365 | 2984 if (charset_id_0 < 0 |
| 2985 || ! CHARSET_ISO_CHARS_96 (CHARSET_FROM_ID (charset_id_0))) | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2986 /* This is SPACE or DEL. */ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2987 charset = CHARSET_FROM_ID (charset_ascii); |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2988 else |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2989 charset = CHARSET_FROM_ID (charset_id_0); |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2990 break; |
| 17052 | 2991 |
| 2992 case ISO_graphic_plane_0: | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2993 if (composition_state != COMPOSING_NO) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2994 { |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2995 if (composition_state == COMPOSING_RULE |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2996 || composition_state == COMPOSING_COMPONENT_RULE) |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2997 { |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2998 DECODE_COMPOSITION_RULE (c1); |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2999 components[component_idx++] = c1; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3000 composition_state--; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3001 continue; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3002 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3003 } |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3004 if (charset_id_0 < 0) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3005 charset = CHARSET_FROM_ID (charset_ascii); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3006 else |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3007 charset = CHARSET_FROM_ID (charset_id_0); |
| 17052 | 3008 break; |
| 3009 | |
| 3010 case ISO_0xA0_or_0xFF: | |
| 88365 | 3011 if (charset_id_1 < 0 |
| 3012 || ! CHARSET_ISO_CHARS_96 (CHARSET_FROM_ID (charset_id_1)) | |
| 3013 || CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) | |
| 3014 goto invalid_code; | |
| 17052 | 3015 /* This is a graphic character, we fall down ... */ |
| 3016 | |
| 3017 case ISO_graphic_plane_1: | |
| 88365 | 3018 if (charset_id_1 < 0) |
| 3019 goto invalid_code; | |
| 3020 charset = CHARSET_FROM_ID (charset_id_1); | |
| 17052 | 3021 break; |
| 3022 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3023 case ISO_control_0: |
| 88365 | 3024 MAYBE_FINISH_COMPOSITION (); |
| 3025 charset = CHARSET_FROM_ID (charset_ascii); | |
| 17052 | 3026 break; |
| 3027 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3028 case ISO_control_1: |
| 88365 | 3029 MAYBE_FINISH_COMPOSITION (); |
| 3030 goto invalid_code; | |
| 17052 | 3031 |
| 3032 case ISO_shift_out: | |
| 88365 | 3033 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LOCKING_SHIFT) |
| 3034 || CODING_ISO_DESIGNATION (coding, 1) < 0) | |
| 3035 goto invalid_code; | |
| 3036 CODING_ISO_INVOCATION (coding, 0) = 1; | |
| 3037 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3038 continue; |
| 17052 | 3039 |
| 3040 case ISO_shift_in: | |
| 88365 | 3041 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LOCKING_SHIFT)) |
| 3042 goto invalid_code; | |
| 3043 CODING_ISO_INVOCATION (coding, 0) = 0; | |
| 3044 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3045 continue; |
| 17052 | 3046 |
| 3047 case ISO_single_shift_2_7: | |
| 3048 case ISO_single_shift_2: | |
| 88365 | 3049 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT)) |
| 3050 goto invalid_code; | |
| 17052 | 3051 /* SS2 is handled as an escape sequence of ESC 'N' */ |
| 3052 c1 = 'N'; | |
| 3053 goto label_escape_sequence; | |
| 3054 | |
| 3055 case ISO_single_shift_3: | |
| 88365 | 3056 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT)) |
| 3057 goto invalid_code; | |
| 17052 | 3058 /* SS2 is handled as an escape sequence of ESC 'O' */ |
| 3059 c1 = 'O'; | |
| 3060 goto label_escape_sequence; | |
| 3061 | |
| 3062 case ISO_control_sequence_introducer: | |
| 3063 /* CSI is handled as an escape sequence of ESC '[' ... */ | |
| 3064 c1 = '['; | |
| 3065 goto label_escape_sequence; | |
| 3066 | |
| 3067 case ISO_escape: | |
| 3068 ONE_MORE_BYTE (c1); | |
| 3069 label_escape_sequence: | |
| 88365 | 3070 /* Escape sequences handled here are invocation, |
| 17052 | 3071 designation, direction specification, and character |
| 3072 composition specification. */ | |
| 3073 switch (c1) | |
| 3074 { | |
| 3075 case '&': /* revision of following character set */ | |
| 3076 ONE_MORE_BYTE (c1); | |
| 3077 if (!(c1 >= '@' && c1 <= '~')) | |
| 88365 | 3078 goto invalid_code; |
| 17052 | 3079 ONE_MORE_BYTE (c1); |
| 3080 if (c1 != ISO_CODE_ESC) | |
| 88365 | 3081 goto invalid_code; |
| 17052 | 3082 ONE_MORE_BYTE (c1); |
| 3083 goto label_escape_sequence; | |
| 3084 | |
| 3085 case '$': /* designation of 2-byte character set */ | |
| 88365 | 3086 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DESIGNATION)) |
| 3087 goto invalid_code; | |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3088 { |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3089 int reg, chars96; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3090 |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3091 ONE_MORE_BYTE (c1); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3092 if (c1 >= '@' && c1 <= 'B') |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3093 { /* designation of JISX0208.1978, GB2312.1980, |
|
23339
2da87b489590
(check_composing_code): Fix previous change. Now it
Kenichi Handa <handa@m17n.org>
parents:
23325
diff
changeset
|
3094 or JISX0208.1980 */ |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3095 reg = 0, chars96 = 0; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3096 } |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3097 else if (c1 >= 0x28 && c1 <= 0x2B) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3098 { /* designation of DIMENSION2_CHARS94 character set */ |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3099 reg = c1 - 0x28, chars96 = 0; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3100 ONE_MORE_BYTE (c1); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3101 } |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3102 else if (c1 >= 0x2C && c1 <= 0x2F) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3103 { /* designation of DIMENSION2_CHARS96 character set */ |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3104 reg = c1 - 0x2C, chars96 = 1; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3105 ONE_MORE_BYTE (c1); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3106 } |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3107 else |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3108 goto invalid_code; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3109 DECODE_DESIGNATION (reg, 2, chars96, c1); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3110 /* We must update these variables now. */ |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3111 if (reg == 0) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3112 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3113 else if (reg == 1) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3114 charset_id_1 = CODING_ISO_INVOKED_CHARSET (coding, 1); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3115 if (chars96 < 0) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3116 goto invalid_code; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3117 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3118 continue; |
| 17052 | 3119 |
| 3120 case 'n': /* invocation of locking-shift-2 */ | |
| 88365 | 3121 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LOCKING_SHIFT) |
| 3122 || CODING_ISO_DESIGNATION (coding, 2) < 0) | |
| 3123 goto invalid_code; | |
| 3124 CODING_ISO_INVOCATION (coding, 0) = 2; | |
| 3125 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3126 continue; |
| 17052 | 3127 |
| 3128 case 'o': /* invocation of locking-shift-3 */ | |
| 88365 | 3129 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LOCKING_SHIFT) |
| 3130 || CODING_ISO_DESIGNATION (coding, 3) < 0) | |
| 3131 goto invalid_code; | |
| 3132 CODING_ISO_INVOCATION (coding, 0) = 3; | |
| 3133 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3134 continue; |
| 17052 | 3135 |
| 3136 case 'N': /* invocation of single-shift-2 */ | |
| 88365 | 3137 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT) |
| 3138 || CODING_ISO_DESIGNATION (coding, 2) < 0) | |
| 3139 goto invalid_code; | |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3140 charset_id_2 = CODING_ISO_DESIGNATION (coding, 2); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3141 if (charset_id_2 < 0) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3142 charset = CHARSET_FROM_ID (charset_ascii); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3143 else |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3144 charset = CHARSET_FROM_ID (charset_id_2); |
| 17052 | 3145 ONE_MORE_BYTE (c1); |
|
30578
705b94e152b1
(decode_coding_iso2022): More strict check for handling single
Kenichi Handa <handa@m17n.org>
parents:
30487
diff
changeset
|
3146 if (c1 < 0x20 || (c1 >= 0x80 && c1 < 0xA0)) |
| 88365 | 3147 goto invalid_code; |
| 17052 | 3148 break; |
| 3149 | |
| 3150 case 'O': /* invocation of single-shift-3 */ | |
| 88365 | 3151 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT) |
| 3152 || CODING_ISO_DESIGNATION (coding, 3) < 0) | |
| 3153 goto invalid_code; | |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3154 charset_id_3 = CODING_ISO_DESIGNATION (coding, 3); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3155 if (charset_id_3 < 0) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3156 charset = CHARSET_FROM_ID (charset_ascii); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3157 else |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3158 charset = CHARSET_FROM_ID (charset_id_3); |
| 17052 | 3159 ONE_MORE_BYTE (c1); |
|
30578
705b94e152b1
(decode_coding_iso2022): More strict check for handling single
Kenichi Handa <handa@m17n.org>
parents:
30487
diff
changeset
|
3160 if (c1 < 0x20 || (c1 >= 0x80 && c1 < 0xA0)) |
| 88365 | 3161 goto invalid_code; |
| 17052 | 3162 break; |
| 3163 | |
| 26847 | 3164 case '0': case '2': case '3': case '4': /* start composition */ |
| 88365 | 3165 if (! (coding->common_flags & CODING_ANNOTATE_COMPOSITION_MASK)) |
| 3166 goto invalid_code; | |
| 26847 | 3167 DECODE_COMPOSITION_START (c1); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3168 continue; |
| 17052 | 3169 |
| 26847 | 3170 case '1': /* end composition */ |
| 88365 | 3171 if (composition_state == COMPOSING_NO) |
| 3172 goto invalid_code; | |
| 3173 DECODE_COMPOSITION_END (); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3174 continue; |
| 17052 | 3175 |
| 3176 case '[': /* specification of direction */ | |
| 88365 | 3177 if (! CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DIRECTION) |
| 3178 goto invalid_code; | |
| 17052 | 3179 /* For the moment, nested direction is not supported. |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3180 So, `coding->mode & CODING_MODE_DIRECTION' zero means |
| 88365 | 3181 left-to-right, and nozero means right-to-left. */ |
| 17052 | 3182 ONE_MORE_BYTE (c1); |
| 3183 switch (c1) | |
| 3184 { | |
| 3185 case ']': /* end of the current direction */ | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3186 coding->mode &= ~CODING_MODE_DIRECTION; |
| 17052 | 3187 |
| 3188 case '0': /* end of the current direction */ | |
| 3189 case '1': /* start of left-to-right direction */ | |
| 3190 ONE_MORE_BYTE (c1); | |
| 3191 if (c1 == ']') | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3192 coding->mode &= ~CODING_MODE_DIRECTION; |
| 17052 | 3193 else |
| 88365 | 3194 goto invalid_code; |
| 17052 | 3195 break; |
| 3196 | |
| 3197 case '2': /* start of right-to-left direction */ | |
| 3198 ONE_MORE_BYTE (c1); | |
| 3199 if (c1 == ']') | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3200 coding->mode |= CODING_MODE_DIRECTION; |
| 17052 | 3201 else |
| 88365 | 3202 goto invalid_code; |
| 17052 | 3203 break; |
| 3204 | |
| 3205 default: | |
| 88365 | 3206 goto invalid_code; |
| 17052 | 3207 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3208 continue; |
| 17052 | 3209 |
| 51311 | 3210 case '%': |
| 3211 ONE_MORE_BYTE (c1); | |
| 3212 if (c1 == '/') | |
| 3213 { | |
| 3214 /* CTEXT extended segment: | |
| 3215 ESC % / [0-4] M L --ENCODING-NAME-- \002 --BYTES-- | |
| 3216 We keep these bytes as is for the moment. | |
| 3217 They may be decoded by post-read-conversion. */ | |
| 3218 int dim, M, L; | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3219 int size; |
| 56191 | 3220 |
| 51311 | 3221 ONE_MORE_BYTE (dim); |
| 3222 ONE_MORE_BYTE (M); | |
| 3223 ONE_MORE_BYTE (L); | |
| 3224 size = ((M - 128) * 128) + (L - 128); | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3225 if (charbuf + 8 + size > charbuf_end) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3226 goto break_loop; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3227 *charbuf++ = ISO_CODE_ESC; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3228 *charbuf++ = '%'; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3229 *charbuf++ = '/'; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3230 *charbuf++ = dim; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3231 *charbuf++ = BYTE8_TO_CHAR (M); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3232 *charbuf++ = BYTE8_TO_CHAR (L); |
| 51311 | 3233 while (size-- > 0) |
| 3234 { | |
| 3235 ONE_MORE_BYTE (c1); | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3236 *charbuf++ = ASCII_BYTE_P (c1) ? c1 : BYTE8_TO_CHAR (c1); |
| 51311 | 3237 } |
| 3238 } | |
| 3239 else if (c1 == 'G') | |
| 3240 { | |
| 3241 /* XFree86 extension for embedding UTF-8 in CTEXT: | |
| 3242 ESC % G --UTF-8-BYTES-- ESC % @ | |
| 3243 We keep these bytes as is for the moment. | |
| 3244 They may be decoded by post-read-conversion. */ | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3245 int *p = charbuf; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3246 |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3247 if (p + 6 > charbuf_end) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3248 goto break_loop; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3249 *p++ = ISO_CODE_ESC; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3250 *p++ = '%'; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3251 *p++ = 'G'; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3252 while (p < charbuf_end) |
| 51311 | 3253 { |
| 3254 ONE_MORE_BYTE (c1); | |
| 3255 if (c1 == ISO_CODE_ESC | |
| 3256 && src + 1 < src_end | |
| 3257 && src[0] == '%' | |
| 3258 && src[1] == '@') | |
|
53239
82690620d562
(decode_coding_iso2022): Fix for preserving UTF-8
Kenichi Handa <handa@m17n.org>
parents:
53087
diff
changeset
|
3259 { |
|
82690620d562
(decode_coding_iso2022): Fix for preserving UTF-8
Kenichi Handa <handa@m17n.org>
parents:
53087
diff
changeset
|
3260 src += 2; |
|
82690620d562
(decode_coding_iso2022): Fix for preserving UTF-8
Kenichi Handa <handa@m17n.org>
parents:
53087
diff
changeset
|
3261 break; |
|
82690620d562
(decode_coding_iso2022): Fix for preserving UTF-8
Kenichi Handa <handa@m17n.org>
parents:
53087
diff
changeset
|
3262 } |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3263 *p++ = ASCII_BYTE_P (c1) ? c1 : BYTE8_TO_CHAR (c1); |
| 51311 | 3264 } |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3265 if (p + 3 > charbuf_end) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3266 goto break_loop; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3267 *p++ = ISO_CODE_ESC; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3268 *p++ = '%'; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3269 *p++ = '@'; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3270 charbuf = p; |
| 51311 | 3271 } |
| 3272 else | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3273 goto invalid_code; |
| 51311 | 3274 continue; |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3275 break; |
| 51311 | 3276 |
| 17052 | 3277 default: |
| 88365 | 3278 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DESIGNATION)) |
| 3279 goto invalid_code; | |
|
89873
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3280 { |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3281 int reg, chars96; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3282 |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3283 if (c1 >= 0x28 && c1 <= 0x2B) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3284 { /* designation of DIMENSION1_CHARS94 character set */ |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3285 reg = c1 - 0x28, chars96 = 0; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3286 ONE_MORE_BYTE (c1); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3287 } |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3288 else if (c1 >= 0x2C && c1 <= 0x2F) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3289 { /* designation of DIMENSION1_CHARS96 character set */ |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3290 reg = c1 - 0x2C, chars96 = 1; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3291 ONE_MORE_BYTE (c1); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3292 } |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3293 else |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3294 goto invalid_code; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3295 DECODE_DESIGNATION (reg, 1, chars96, c1); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3296 /* We must update these variables now. */ |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3297 if (reg == 0) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3298 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3299 else if (reg == 1) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3300 charset_id_1 = CODING_ISO_INVOKED_CHARSET (coding, 1); |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3301 if (chars96 < 0) |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3302 goto invalid_code; |
|
9a279ff9d245
(DECODE_DESIGNATION): Set chars_96 to -1 instead of
Kenichi Handa <handa@m17n.org>
parents:
89863
diff
changeset
|
3303 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3304 continue; |
| 17052 | 3305 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3306 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3307 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3308 if (charset->id != charset_ascii |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3309 && last_id != charset->id) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3310 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3311 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
3312 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3313 last_id = charset->id; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3314 last_offset = char_offset; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3315 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3316 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3317 /* Now we know CHARSET and 1st position code C1 of a character. |
| 88365 | 3318 Produce a decoded character while getting 2nd position code |
| 3319 C2 if necessary. */ | |
| 3320 c1 &= 0x7F; | |
| 3321 if (CHARSET_DIMENSION (charset) > 1) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3322 { |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3323 ONE_MORE_BYTE (c2); |
| 88365 | 3324 if (c2 < 0x20 || (c2 >= 0x80 && c2 < 0xA0)) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3325 /* C2 is not in a valid range. */ |
| 88365 | 3326 goto invalid_code; |
| 3327 c1 = (c1 << 8) | (c2 & 0x7F); | |
| 3328 if (CHARSET_DIMENSION (charset) > 2) | |
| 3329 { | |
| 3330 ONE_MORE_BYTE (c2); | |
| 3331 if (c2 < 0x20 || (c2 >= 0x80 && c2 < 0xA0)) | |
| 3332 /* C2 is not in a valid range. */ | |
| 3333 goto invalid_code; | |
| 3334 c1 = (c1 << 8) | (c2 & 0x7F); | |
| 3335 } | |
| 17052 | 3336 } |
| 88365 | 3337 |
| 3338 CODING_DECODE_CHAR (coding, src, src_base, src_end, charset, c1, c); | |
| 3339 if (c < 0) | |
| 3340 { | |
| 3341 MAYBE_FINISH_COMPOSITION (); | |
| 3342 for (; src_base < src; src_base++, char_offset++) | |
| 3343 { | |
| 3344 if (ASCII_BYTE_P (*src_base)) | |
| 3345 *charbuf++ = *src_base; | |
| 3346 else | |
| 3347 *charbuf++ = BYTE8_TO_CHAR (*src_base); | |
| 3348 } | |
| 3349 } | |
| 3350 else if (composition_state == COMPOSING_NO) | |
| 3351 { | |
| 3352 *charbuf++ = c; | |
| 3353 char_offset++; | |
| 3354 } | |
| 3355 else | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3356 { |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3357 components[component_idx++] = c; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3358 if (method == COMPOSITION_WITH_RULE |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3359 || (method == COMPOSITION_WITH_RULE_ALTCHARS |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3360 && composition_state == COMPOSING_COMPONENT_CHAR)) |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3361 composition_state++; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3362 } |
| 17052 | 3363 continue; |
| 3364 | |
| 88365 | 3365 invalid_code: |
| 3366 MAYBE_FINISH_COMPOSITION (); | |
| 3367 src = src_base; | |
| 3368 consumed_chars = consumed_chars_base; | |
| 3369 ONE_MORE_BYTE (c); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
3370 *charbuf++ = c < 0 ? -c : ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3371 char_offset++; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3372 coding->errors++; |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3373 continue; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3374 |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3375 break_loop: |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
3376 break; |
| 88365 | 3377 } |
| 3378 | |
| 3379 no_more_source: | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3380 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
3381 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
| 88365 | 3382 coding->consumed_char += consumed_chars_base; |
| 3383 coding->consumed = src_base - coding->source; | |
| 3384 coding->charbuf_used = charbuf - coding->charbuf; | |
| 17052 | 3385 } |
| 3386 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3387 |
| 18766 | 3388 /* ISO2022 encoding stuff. */ |
| 17052 | 3389 |
| 3390 /* | |
| 18766 | 3391 It is not enough to say just "ISO2022" on encoding, we have to |
| 88365 | 3392 specify more details. In Emacs, each coding system of ISO2022 |
| 17052 | 3393 variant has the following specifications: |
| 88365 | 3394 1. Initial designation to G0 thru G3. |
| 17052 | 3395 2. Allows short-form designation? |
| 3396 3. ASCII should be designated to G0 before control characters? | |
| 3397 4. ASCII should be designated to G0 at end of line? | |
| 3398 5. 7-bit environment or 8-bit environment? | |
| 3399 6. Use locking-shift? | |
| 3400 7. Use Single-shift? | |
| 3401 And the following two are only for Japanese: | |
| 3402 8. Use ASCII in place of JIS0201-1976-Roman? | |
| 3403 9. Use JISX0208-1983 in place of JISX0208-1978? | |
| 88365 | 3404 These specifications are encoded in CODING_ISO_FLAGS (coding) as flag bits |
| 3405 defined by macros CODING_ISO_FLAG_XXX. See `coding.h' for more | |
| 18766 | 3406 details. |
| 17052 | 3407 */ |
| 3408 | |
| 3409 /* Produce codes (escape sequence) for designating CHARSET to graphic | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3410 register REG at DST, and increment DST. If <final-char> of CHARSET is |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3411 '@', 'A', or 'B' and the coding system CODING allows, produce |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3412 designation sequence of short-form. */ |
| 17052 | 3413 |
| 3414 #define ENCODE_DESIGNATION(charset, reg, coding) \ | |
| 3415 do { \ | |
| 88365 | 3416 unsigned char final_char = CHARSET_ISO_FINAL (charset); \ |
| 17052 | 3417 char *intermediate_char_94 = "()*+"; \ |
| 3418 char *intermediate_char_96 = ",-./"; \ | |
| 88365 | 3419 int revision = -1; \ |
| 3420 int c; \ | |
| 3421 \ | |
| 3422 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_REVISION) \ | |
| 88856 | 3423 revision = CHARSET_ISO_REVISION (charset); \ |
| 88365 | 3424 \ |
| 3425 if (revision >= 0) \ | |
|
20150
402b6e5f4b58
(encode_designation_at_bol): Fix bug of finding graphic
Kenichi Handa <handa@m17n.org>
parents:
20105
diff
changeset
|
3426 { \ |
| 88365 | 3427 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, '&'); \ |
| 3428 EMIT_ONE_BYTE ('@' + revision); \ | |
| 17052 | 3429 } \ |
| 88365 | 3430 EMIT_ONE_ASCII_BYTE (ISO_CODE_ESC); \ |
| 17052 | 3431 if (CHARSET_DIMENSION (charset) == 1) \ |
| 3432 { \ | |
| 88365 | 3433 if (! CHARSET_ISO_CHARS_96 (charset)) \ |
| 3434 c = intermediate_char_94[reg]; \ | |
| 17052 | 3435 else \ |
| 88365 | 3436 c = intermediate_char_96[reg]; \ |
| 3437 EMIT_ONE_ASCII_BYTE (c); \ | |
| 17052 | 3438 } \ |
| 3439 else \ | |
| 3440 { \ | |
| 88365 | 3441 EMIT_ONE_ASCII_BYTE ('$'); \ |
| 3442 if (! CHARSET_ISO_CHARS_96 (charset)) \ | |
| 17052 | 3443 { \ |
| 88365 | 3444 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LONG_FORM \ |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3445 || reg != 0 \ |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3446 || final_char < '@' || final_char > 'B') \ |
| 88365 | 3447 EMIT_ONE_ASCII_BYTE (intermediate_char_94[reg]); \ |
| 17052 | 3448 } \ |
| 3449 else \ | |
| 88365 | 3450 EMIT_ONE_ASCII_BYTE (intermediate_char_96[reg]); \ |
| 17052 | 3451 } \ |
| 88365 | 3452 EMIT_ONE_ASCII_BYTE (final_char); \ |
| 3453 \ | |
| 3454 CODING_ISO_DESIGNATION (coding, reg) = CHARSET_ID (charset); \ | |
| 17052 | 3455 } while (0) |
| 3456 | |
| 88365 | 3457 |
| 17052 | 3458 /* The following two macros produce codes (control character or escape |
| 3459 sequence) for ISO2022 single-shift functions (single-shift-2 and | |
| 3460 single-shift-3). */ | |
| 3461 | |
| 88365 | 3462 #define ENCODE_SINGLE_SHIFT_2 \ |
| 3463 do { \ | |
| 3464 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) \ | |
| 3465 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, 'N'); \ | |
| 3466 else \ | |
| 3467 EMIT_ONE_BYTE (ISO_CODE_SS2); \ | |
| 3468 CODING_ISO_SINGLE_SHIFTING (coding) = 1; \ | |
| 17052 | 3469 } while (0) |
| 3470 | |
| 88365 | 3471 |
| 3472 #define ENCODE_SINGLE_SHIFT_3 \ | |
| 3473 do { \ | |
| 3474 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) \ | |
| 3475 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, 'O'); \ | |
| 3476 else \ | |
| 3477 EMIT_ONE_BYTE (ISO_CODE_SS3); \ | |
| 3478 CODING_ISO_SINGLE_SHIFTING (coding) = 1; \ | |
| 17052 | 3479 } while (0) |
| 3480 | |
| 88365 | 3481 |
| 17052 | 3482 /* The following four macros produce codes (control character or |
| 3483 escape sequence) for ISO2022 locking-shift functions (shift-in, | |
| 3484 shift-out, locking-shift-2, and locking-shift-3). */ | |
| 3485 | |
| 88365 | 3486 #define ENCODE_SHIFT_IN \ |
| 3487 do { \ | |
| 3488 EMIT_ONE_ASCII_BYTE (ISO_CODE_SI); \ | |
| 3489 CODING_ISO_INVOCATION (coding, 0) = 0; \ | |
| 17052 | 3490 } while (0) |
| 3491 | |
| 88365 | 3492 |
| 3493 #define ENCODE_SHIFT_OUT \ | |
| 3494 do { \ | |
| 3495 EMIT_ONE_ASCII_BYTE (ISO_CODE_SO); \ | |
| 3496 CODING_ISO_INVOCATION (coding, 0) = 1; \ | |
| 17052 | 3497 } while (0) |
| 3498 | |
| 88365 | 3499 |
| 3500 #define ENCODE_LOCKING_SHIFT_2 \ | |
| 3501 do { \ | |
| 3502 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, 'n'); \ | |
| 3503 CODING_ISO_INVOCATION (coding, 0) = 2; \ | |
| 17052 | 3504 } while (0) |
| 3505 | |
| 88365 | 3506 |
| 3507 #define ENCODE_LOCKING_SHIFT_3 \ | |
| 3508 do { \ | |
| 3509 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, 'n'); \ | |
| 3510 CODING_ISO_INVOCATION (coding, 0) = 3; \ | |
| 17052 | 3511 } while (0) |
| 3512 | |
| 88365 | 3513 |
| 18766 | 3514 /* Produce codes for a DIMENSION1 character whose character set is |
| 3515 CHARSET and whose position-code is C1. Designation and invocation | |
| 17052 | 3516 sequences are also produced in advance if necessary. */ |
| 3517 | |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3518 #define ENCODE_ISO_CHARACTER_DIMENSION1(charset, c1) \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3519 do { \ |
| 88365 | 3520 int id = CHARSET_ID (charset); \ |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3521 \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3522 if ((CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_USE_ROMAN) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3523 && id == charset_ascii) \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3524 { \ |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3525 id = charset_jisx0201_roman; \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3526 charset = CHARSET_FROM_ID (id); \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3527 } \ |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3528 \ |
| 88365 | 3529 if (CODING_ISO_SINGLE_SHIFTING (coding)) \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3530 { \ |
| 88365 | 3531 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) \ |
| 3532 EMIT_ONE_ASCII_BYTE (c1 & 0x7F); \ | |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3533 else \ |
| 88365 | 3534 EMIT_ONE_BYTE (c1 | 0x80); \ |
| 3535 CODING_ISO_SINGLE_SHIFTING (coding) = 0; \ | |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3536 break; \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3537 } \ |
| 88365 | 3538 else if (id == CODING_ISO_INVOKED_CHARSET (coding, 0)) \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3539 { \ |
| 88365 | 3540 EMIT_ONE_ASCII_BYTE (c1 & 0x7F); \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3541 break; \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3542 } \ |
| 88365 | 3543 else if (id == CODING_ISO_INVOKED_CHARSET (coding, 1)) \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3544 { \ |
| 88365 | 3545 EMIT_ONE_BYTE (c1 | 0x80); \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3546 break; \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3547 } \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3548 else \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3549 /* Since CHARSET is not yet invoked to any graphic planes, we \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3550 must invoke it, or, at first, designate it to some graphic \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3551 register. Then repeat the loop to actually produce the \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3552 character. */ \ |
| 88365 | 3553 dst = encode_invocation_designation (charset, coding, dst, \ |
| 3554 &produced_chars); \ | |
| 17052 | 3555 } while (1) |
| 3556 | |
| 88365 | 3557 |
| 3558 /* Produce codes for a DIMENSION2 character whose character set is | |
| 3559 CHARSET and whose position-codes are C1 and C2. Designation and | |
| 3560 invocation codes are also produced in advance if necessary. */ | |
| 3561 | |
| 3562 #define ENCODE_ISO_CHARACTER_DIMENSION2(charset, c1, c2) \ | |
|
24506
219c99669e4b
(ENCODE_ISO_CHARACTER): Check validity of CHARSET. If
Kenichi Handa <handa@m17n.org>
parents:
24460
diff
changeset
|
3563 do { \ |
| 88365 | 3564 int id = CHARSET_ID (charset); \ |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3565 \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3566 if ((CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_USE_OLDJIS) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3567 && id == charset_jisx0208) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3568 { \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3569 id = charset_jisx0208_1978; \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3570 charset = CHARSET_FROM_ID (id); \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3571 } \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3572 \ |
| 88365 | 3573 if (CODING_ISO_SINGLE_SHIFTING (coding)) \ |
| 3574 { \ | |
| 3575 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) \ | |
| 3576 EMIT_TWO_ASCII_BYTES ((c1) & 0x7F, (c2) & 0x7F); \ | |
| 3577 else \ | |
| 3578 EMIT_TWO_BYTES ((c1) | 0x80, (c2) | 0x80); \ | |
| 3579 CODING_ISO_SINGLE_SHIFTING (coding) = 0; \ | |
| 3580 break; \ | |
| 3581 } \ | |
| 3582 else if (id == CODING_ISO_INVOKED_CHARSET (coding, 0)) \ | |
| 3583 { \ | |
| 3584 EMIT_TWO_ASCII_BYTES ((c1) & 0x7F, (c2) & 0x7F); \ | |
| 3585 break; \ | |
| 3586 } \ | |
| 3587 else if (id == CODING_ISO_INVOKED_CHARSET (coding, 1)) \ | |
| 3588 { \ | |
| 3589 EMIT_TWO_BYTES ((c1) | 0x80, (c2) | 0x80); \ | |
| 3590 break; \ | |
| 3591 } \ | |
| 3592 else \ | |
| 3593 /* Since CHARSET is not yet invoked to any graphic planes, we \ | |
| 3594 must invoke it, or, at first, designate it to some graphic \ | |
| 3595 register. Then repeat the loop to actually produce the \ | |
| 3596 character. */ \ | |
| 3597 dst = encode_invocation_designation (charset, coding, dst, \ | |
| 3598 &produced_chars); \ | |
| 3599 } while (1) | |
| 3600 | |
| 3601 | |
| 3602 #define ENCODE_ISO_CHARACTER(charset, c) \ | |
| 3603 do { \ | |
| 3604 int code = ENCODE_CHAR ((charset),(c)); \ | |
| 3605 \ | |
| 3606 if (CHARSET_DIMENSION (charset) == 1) \ | |
| 3607 ENCODE_ISO_CHARACTER_DIMENSION1 ((charset), code); \ | |
| 3608 else \ | |
| 3609 ENCODE_ISO_CHARACTER_DIMENSION2 ((charset), code >> 8, code & 0xFF); \ | |
|
22119
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
3610 } while (0) |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3611 |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
3612 |
| 17052 | 3613 /* Produce designation and invocation codes at a place pointed by DST |
| 88365 | 3614 to use CHARSET. The element `spec.iso_2022' of *CODING is updated. |
| 17052 | 3615 Return new DST. */ |
| 3616 | |
| 3617 unsigned char * | |
| 88365 | 3618 encode_invocation_designation (charset, coding, dst, p_nchars) |
| 3619 struct charset *charset; | |
| 17052 | 3620 struct coding_system *coding; |
| 3621 unsigned char *dst; | |
| 88365 | 3622 int *p_nchars; |
| 17052 | 3623 { |
| 88365 | 3624 int multibytep = coding->dst_multibyte; |
| 3625 int produced_chars = *p_nchars; | |
| 17052 | 3626 int reg; /* graphic register number */ |
| 88365 | 3627 int id = CHARSET_ID (charset); |
| 17052 | 3628 |
| 3629 /* At first, check designations. */ | |
| 3630 for (reg = 0; reg < 4; reg++) | |
| 88365 | 3631 if (id == CODING_ISO_DESIGNATION (coding, reg)) |
| 17052 | 3632 break; |
| 3633 | |
| 3634 if (reg >= 4) | |
| 3635 { | |
| 3636 /* CHARSET is not yet designated to any graphic registers. */ | |
| 3637 /* At first check the requested designation. */ | |
| 88365 | 3638 reg = CODING_ISO_REQUEST (coding, id); |
| 3639 if (reg < 0) | |
|
18002
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
3640 /* Since CHARSET requests no special designation, designate it |
|
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
3641 to graphic register 0. */ |
| 17052 | 3642 reg = 0; |
| 3643 | |
| 3644 ENCODE_DESIGNATION (charset, reg, coding); | |
| 3645 } | |
| 3646 | |
| 88365 | 3647 if (CODING_ISO_INVOCATION (coding, 0) != reg |
| 3648 && CODING_ISO_INVOCATION (coding, 1) != reg) | |
| 17052 | 3649 { |
| 3650 /* Since the graphic register REG is not invoked to any graphic | |
| 3651 planes, invoke it to graphic plane 0. */ | |
| 3652 switch (reg) | |
| 3653 { | |
| 3654 case 0: /* graphic register 0 */ | |
| 3655 ENCODE_SHIFT_IN; | |
| 3656 break; | |
| 3657 | |
| 3658 case 1: /* graphic register 1 */ | |
| 3659 ENCODE_SHIFT_OUT; | |
| 3660 break; | |
| 3661 | |
| 3662 case 2: /* graphic register 2 */ | |
| 88365 | 3663 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT) |
| 17052 | 3664 ENCODE_SINGLE_SHIFT_2; |
| 3665 else | |
| 3666 ENCODE_LOCKING_SHIFT_2; | |
| 3667 break; | |
| 3668 | |
| 3669 case 3: /* graphic register 3 */ | |
| 88365 | 3670 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT) |
| 17052 | 3671 ENCODE_SINGLE_SHIFT_3; |
| 3672 else | |
| 3673 ENCODE_LOCKING_SHIFT_3; | |
| 3674 break; | |
| 3675 } | |
| 3676 } | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3677 |
| 88365 | 3678 *p_nchars = produced_chars; |
| 17052 | 3679 return dst; |
| 3680 } | |
| 3681 | |
| 3682 /* The following three macros produce codes for indicating direction | |
| 3683 of text. */ | |
| 88365 | 3684 #define ENCODE_CONTROL_SEQUENCE_INTRODUCER \ |
| 3685 do { \ | |
| 3686 if (CODING_ISO_FLAGS (coding) == CODING_ISO_FLAG_SEVEN_BITS) \ | |
| 3687 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, '['); \ | |
| 3688 else \ | |
| 3689 EMIT_ONE_BYTE (ISO_CODE_CSI); \ | |
| 17052 | 3690 } while (0) |
| 3691 | |
| 88365 | 3692 |
| 3693 #define ENCODE_DIRECTION_R2L() \ | |
| 3694 do { \ | |
| 3695 ENCODE_CONTROL_SEQUENCE_INTRODUCER (dst); \ | |
| 3696 EMIT_TWO_ASCII_BYTES ('2', ']'); \ | |
| 3697 } while (0) | |
| 3698 | |
| 3699 | |
| 3700 #define ENCODE_DIRECTION_L2R() \ | |
| 3701 do { \ | |
| 3702 ENCODE_CONTROL_SEQUENCE_INTRODUCER (dst); \ | |
| 3703 EMIT_TWO_ASCII_BYTES ('0', ']'); \ | |
| 3704 } while (0) | |
| 3705 | |
| 17052 | 3706 |
| 3707 /* Produce codes for designation and invocation to reset the graphic | |
| 3708 planes and registers to initial state. */ | |
| 88365 | 3709 #define ENCODE_RESET_PLANE_AND_REGISTER() \ |
| 3710 do { \ | |
| 3711 int reg; \ | |
| 3712 struct charset *charset; \ | |
| 3713 \ | |
| 3714 if (CODING_ISO_INVOCATION (coding, 0) != 0) \ | |
| 3715 ENCODE_SHIFT_IN; \ | |
| 3716 for (reg = 0; reg < 4; reg++) \ | |
| 3717 if (CODING_ISO_INITIAL (coding, reg) >= 0 \ | |
| 3718 && (CODING_ISO_DESIGNATION (coding, reg) \ | |
| 3719 != CODING_ISO_INITIAL (coding, reg))) \ | |
| 3720 { \ | |
| 3721 charset = CHARSET_FROM_ID (CODING_ISO_INITIAL (coding, reg)); \ | |
| 3722 ENCODE_DESIGNATION (charset, reg, coding); \ | |
| 3723 } \ | |
| 17052 | 3724 } while (0) |
| 3725 | |
| 88365 | 3726 |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3727 /* Produce designation sequences of charsets in the line started from |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3728 SRC to a place pointed by DST, and return updated DST. |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3729 |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3730 If the current block ends before any end-of-line, we may fail to |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3731 find all the necessary designations. */ |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3732 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3733 static unsigned char * |
| 88365 | 3734 encode_designation_at_bol (coding, charbuf, charbuf_end, dst) |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3735 struct coding_system *coding; |
| 88365 | 3736 int *charbuf, *charbuf_end; |
|
59168
0345f2b10f1d
(decode_coding_XXX, decode_composition_emacs_mule)
Dan Nicolaescu <dann@ics.uci.edu>
parents:
59095
diff
changeset
|
3737 unsigned char *dst; |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3738 { |
| 88365 | 3739 struct charset *charset; |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3740 /* Table of charsets to be designated to each graphic register. */ |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3741 int r[4]; |
| 88365 | 3742 int c, found = 0, reg; |
| 3743 int produced_chars = 0; | |
| 3744 int multibytep = coding->dst_multibyte; | |
| 3745 Lisp_Object attrs; | |
| 3746 Lisp_Object charset_list; | |
| 3747 | |
| 3748 attrs = CODING_ID_ATTRS (coding->id); | |
| 3749 charset_list = CODING_ATTR_CHARSET_LIST (attrs); | |
| 3750 if (EQ (charset_list, Qiso_2022)) | |
| 3751 charset_list = Viso_2022_charset_list; | |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3752 |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3753 for (reg = 0; reg < 4; reg++) |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3754 r[reg] = -1; |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3755 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3756 while (found < 4) |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3757 { |
| 88365 | 3758 int id; |
| 3759 | |
| 3760 c = *charbuf++; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3761 if (c == '\n') |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3762 break; |
| 88365 | 3763 charset = char_charset (c, charset_list, NULL); |
| 3764 id = CHARSET_ID (charset); | |
| 3765 reg = CODING_ISO_REQUEST (coding, id); | |
| 3766 if (reg >= 0 && r[reg] < 0) | |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3767 { |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3768 found++; |
| 88365 | 3769 r[reg] = id; |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3770 } |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3771 } |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3772 |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3773 if (found) |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3774 { |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3775 for (reg = 0; reg < 4; reg++) |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3776 if (r[reg] >= 0 |
| 88365 | 3777 && CODING_ISO_DESIGNATION (coding, reg) != r[reg]) |
| 3778 ENCODE_DESIGNATION (CHARSET_FROM_ID (r[reg]), reg, coding); | |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3779 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3780 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3781 return dst; |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3782 } |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3783 |
| 17052 | 3784 /* See the above "GENERAL NOTES on `encode_coding_XXX ()' functions". */ |
| 3785 | |
| 88365 | 3786 static int |
| 3787 encode_coding_iso_2022 (coding) | |
| 17052 | 3788 struct coding_system *coding; |
| 3789 { | |
| 88365 | 3790 int multibytep = coding->dst_multibyte; |
| 3791 int *charbuf = coding->charbuf; | |
| 3792 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 3793 unsigned char *dst = coding->destination + coding->produced; | |
| 3794 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 3795 int safe_room = 16; | |
| 3796 int bol_designation | |
| 3797 = (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DESIGNATE_AT_BOL | |
| 3798 && CODING_ISO_BOL (coding)); | |
| 3799 int produced_chars = 0; | |
| 3800 Lisp_Object attrs, eol_type, charset_list; | |
| 3801 int ascii_compatible; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3802 int c; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3803 int preferred_charset_id = -1; |
| 88365 | 3804 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
3805 CODING_GET_INFO (coding, attrs, charset_list); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
3806 eol_type = CODING_ID_EOL_TYPE (coding->id); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
3807 if (VECTORP (eol_type)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
3808 eol_type = Qunix; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
3809 |
|
88497
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
3810 setup_iso_safe_charsets (attrs); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3811 /* Charset list may have been changed. */ |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
3812 charset_list = CODING_ATTR_CHARSET_LIST (attrs); |
| 89483 | 3813 coding->safe_charsets = (char *) SDATA (CODING_ATTR_SAFE_CHARSETS(attrs)); |
| 88365 | 3814 |
| 3815 ascii_compatible = ! NILP (CODING_ATTR_ASCII_COMPAT (attrs)); | |
| 3816 | |
| 3817 while (charbuf < charbuf_end) | |
| 3818 { | |
| 3819 ASSURE_DESTINATION (safe_room); | |
| 3820 | |
| 3821 if (bol_designation) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3822 { |
| 88365 | 3823 unsigned char *dst_prev = dst; |
| 3824 | |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3825 /* We have to produce designation sequences if any now. */ |
| 88365 | 3826 dst = encode_designation_at_bol (coding, charbuf, charbuf_end, dst); |
| 3827 bol_designation = 0; | |
| 3828 /* We are sure that designation sequences are all ASCII bytes. */ | |
| 3829 produced_chars += dst - dst_prev; | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3830 } |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3831 |
| 88365 | 3832 c = *charbuf++; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3833 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3834 if (c < 0) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3835 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3836 /* Handle an annotation. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3837 switch (*charbuf) |
| 17052 | 3838 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3839 case CODING_ANNOTATE_COMPOSITION_MASK: |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3840 /* Not yet implemented. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3841 break; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3842 case CODING_ANNOTATE_CHARSET_MASK: |
|
90014
ade0c9a12f99
(encode_coding_iso_2022): Fix handling of charset
Kenichi Handa <handa@m17n.org>
parents:
90011
diff
changeset
|
3843 preferred_charset_id = charbuf[2]; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3844 if (preferred_charset_id >= 0 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3845 && NILP (Fmemq (make_number (preferred_charset_id), |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3846 charset_list))) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3847 preferred_charset_id = -1; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3848 break; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3849 default: |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3850 abort (); |
| 26847 | 3851 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3852 charbuf += -c - 1; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3853 continue; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3854 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3855 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3856 /* Now encode the character C. */ |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3857 if (c < 0x20 || c == 0x7F) |
| 17052 | 3858 { |
| 88365 | 3859 if (c == '\n' |
| 3860 || (c == '\r' && EQ (eol_type, Qmac))) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3861 { |
| 88365 | 3862 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_RESET_AT_EOL) |
| 3863 ENCODE_RESET_PLANE_AND_REGISTER (); | |
| 3864 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_INIT_AT_BOL) | |
| 3865 { | |
| 3866 int i; | |
| 3867 | |
| 3868 for (i = 0; i < 4; i++) | |
| 3869 CODING_ISO_DESIGNATION (coding, i) | |
| 3870 = CODING_ISO_INITIAL (coding, i); | |
| 3871 } | |
| 3872 bol_designation | |
| 3873 = CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DESIGNATE_AT_BOL; | |
|
19052
302a7b2a6948
(encode_coding_iso2022): Write out invalid multibyte
Kenichi Handa <handa@m17n.org>
parents:
18910
diff
changeset
|
3874 } |
| 88365 | 3875 else if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_RESET_AT_CNTL) |
| 3876 ENCODE_RESET_PLANE_AND_REGISTER (); | |
| 3877 EMIT_ONE_ASCII_BYTE (c); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3878 } |
| 88365 | 3879 else if (ASCII_CHAR_P (c)) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3880 { |
| 88365 | 3881 if (ascii_compatible) |
| 3882 EMIT_ONE_ASCII_BYTE (c); | |
| 3883 else | |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3884 { |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3885 struct charset *charset = CHARSET_FROM_ID (charset_ascii); |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3886 ENCODE_ISO_CHARACTER (charset, c); |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3887 } |
| 17052 | 3888 } |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3889 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3890 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3891 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3892 EMIT_ONE_BYTE (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3893 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3894 else |
| 88365 | 3895 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3896 struct charset *charset; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3897 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3898 if (preferred_charset_id >= 0) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3899 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3900 charset = CHARSET_FROM_ID (preferred_charset_id); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3901 if (! CHAR_CHARSET_P (c, charset)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3902 charset = char_charset (c, charset_list, NULL); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3903 } |
|
42104
d69c2368e549
(DECODE_COMPOSITION_END): Fixed a typo in the last
Sam Steingold <sds@gnu.org>
parents:
42103
diff
changeset
|
3904 else |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3905 charset = char_charset (c, charset_list, NULL); |
| 88365 | 3906 if (!charset) |
| 17052 | 3907 { |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3908 if (coding->mode & CODING_MODE_SAFE_ENCODING) |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3909 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3910 c = CODING_INHIBIT_CHARACTER_SUBSTITUTION; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3911 charset = CHARSET_FROM_ID (charset_ascii); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3912 } |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3913 else |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3914 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3915 c = coding->default_char; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3916 charset = char_charset (c, charset_list, NULL); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3917 } |
|
19052
302a7b2a6948
(encode_coding_iso2022): Write out invalid multibyte
Kenichi Handa <handa@m17n.org>
parents:
18910
diff
changeset
|
3918 } |
| 88365 | 3919 ENCODE_ISO_CHARACTER (charset, c); |
| 3920 } | |
| 3921 } | |
| 3922 | |
| 3923 if (coding->mode & CODING_MODE_LAST_BLOCK | |
| 3924 && CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_RESET_AT_EOL) | |
| 3925 { | |
| 3926 ASSURE_DESTINATION (safe_room); | |
| 3927 ENCODE_RESET_PLANE_AND_REGISTER (); | |
| 3928 } | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
3929 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 3930 CODING_ISO_BOL (coding) = bol_designation; |
| 3931 coding->produced_char += produced_chars; | |
| 3932 coding->produced = dst - coding->destination; | |
| 3933 return 0; | |
| 17052 | 3934 } |
| 3935 | |
| 3936 | |
| 88365 | 3937 /*** 8,9. SJIS and BIG5 handlers ***/ |
| 3938 | |
| 3939 /* Although SJIS and BIG5 are not ISO's coding system, they are used | |
| 17052 | 3940 quite widely. So, for the moment, Emacs supports them in the bare |
| 3941 C code. But, in the future, they may be supported only by CCL. */ | |
| 3942 | |
| 3943 /* SJIS is a coding system encoding three character sets: ASCII, right | |
| 3944 half of JISX0201-Kana, and JISX0208. An ASCII character is encoded | |
| 3945 as is. A character of charset katakana-jisx0201 is encoded by | |
| 3946 "position-code + 0x80". A character of charset japanese-jisx0208 | |
| 3947 is encoded in 2-byte but two position-codes are divided and shifted | |
| 88365 | 3948 so that it fit in the range below. |
| 17052 | 3949 |
| 3950 --- CODE RANGE of SJIS --- | |
| 3951 (character set) (range) | |
| 3952 ASCII 0x00 .. 0x7F | |
| 88365 | 3953 KATAKANA-JISX0201 0xA0 .. 0xDF |
|
24324
2eec590faf26
(Fdecode_sjis_char, Fencode_sjis_char): Hanlde
Kenichi Handa <handa@m17n.org>
parents:
24316
diff
changeset
|
3954 JISX0208 (1st byte) 0x81 .. 0x9F and 0xE0 .. 0xEF |
|
23564
6eb3e346d1fd
(DECODE_CHARACTER_ASCII): Check validity of inserted
Kenichi Handa <handa@m17n.org>
parents:
23542
diff
changeset
|
3955 (2nd byte) 0x40 .. 0x7E and 0x80 .. 0xFC |
| 17052 | 3956 ------------------------------- |
| 3957 | |
| 3958 */ | |
| 3959 | |
| 3960 /* BIG5 is a coding system encoding two character sets: ASCII and | |
| 3961 Big5. An ASCII character is encoded as is. Big5 is a two-byte | |
| 88365 | 3962 character set and is encoded in two-byte. |
| 17052 | 3963 |
| 3964 --- CODE RANGE of BIG5 --- | |
| 3965 (character set) (range) | |
| 3966 ASCII 0x00 .. 0x7F | |
| 3967 Big5 (1st byte) 0xA1 .. 0xFE | |
| 3968 (2nd byte) 0x40 .. 0x7E and 0xA1 .. 0xFE | |
| 3969 -------------------------- | |
| 3970 | |
| 88365 | 3971 */ |
| 17052 | 3972 |
| 3973 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
| 3974 Check if a text is encoded in SJIS. If it is, return | |
| 88365 | 3975 CATEGORY_MASK_SJIS, else return 0. */ |
| 17052 | 3976 |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
3977 static int |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3978 detect_coding_sjis (coding, detect_info) |
| 88365 | 3979 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3980 struct coding_detection_info *detect_info; |
| 17052 | 3981 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
3982 const unsigned char *src = coding->source, *src_base; |
| 89483 | 3983 const unsigned char *src_end = coding->source + coding->src_bytes; |
| 88365 | 3984 int multibytep = coding->src_multibyte; |
| 3985 int consumed_chars = 0; | |
| 3986 int found = 0; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3987 int c; |
| 88365 | 3988 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
3989 detect_info->checked |= CATEGORY_MASK_SJIS; |
| 88365 | 3990 /* A coding system of this category is always ASCII compatible. */ |
| 3991 src += coding->head_ascii; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3992 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3993 while (1) |
| 17052 | 3994 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
3995 src_base = src; |
| 88365 | 3996 ONE_MORE_BYTE (c); |
|
36647
0a75ccbe42b2
(detect_coding_sjis): Do more rigid check.
Kenichi Handa <handa@m17n.org>
parents:
36520
diff
changeset
|
3997 if (c < 0x80) |
|
0a75ccbe42b2
(detect_coding_sjis): Do more rigid check.
Kenichi Handa <handa@m17n.org>
parents:
36520
diff
changeset
|
3998 continue; |
| 88365 | 3999 if ((c >= 0x81 && c <= 0x9F) || (c >= 0xE0 && c <= 0xEF)) |
| 17052 | 4000 { |
| 88365 | 4001 ONE_MORE_BYTE (c); |
|
36647
0a75ccbe42b2
(detect_coding_sjis): Do more rigid check.
Kenichi Handa <handa@m17n.org>
parents:
36520
diff
changeset
|
4002 if (c < 0x40 || c == 0x7F || c > 0xFC) |
| 88365 | 4003 break; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4004 found = CATEGORY_MASK_SJIS; |
| 17052 | 4005 } |
| 88365 | 4006 else if (c >= 0xA0 && c < 0xE0) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4007 found = CATEGORY_MASK_SJIS; |
| 88365 | 4008 else |
| 4009 break; | |
| 4010 } | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4011 detect_info->rejected |= CATEGORY_MASK_SJIS; |
| 88365 | 4012 return 0; |
| 4013 | |
| 4014 no_more_source: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4015 if (src_base < src && coding->mode & CODING_MODE_LAST_BLOCK) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4016 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4017 detect_info->rejected |= CATEGORY_MASK_SJIS; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4018 return 0; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4019 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4020 detect_info->found |= found; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4021 return 1; |
| 17052 | 4022 } |
| 4023 | |
| 4024 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
| 4025 Check if a text is encoded in BIG5. If it is, return | |
| 88365 | 4026 CATEGORY_MASK_BIG5, else return 0. */ |
| 17052 | 4027 |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
4028 static int |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4029 detect_coding_big5 (coding, detect_info) |
| 88365 | 4030 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4031 struct coding_detection_info *detect_info; |
| 17052 | 4032 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4033 const unsigned char *src = coding->source, *src_base; |
| 89483 | 4034 const unsigned char *src_end = coding->source + coding->src_bytes; |
| 88365 | 4035 int multibytep = coding->src_multibyte; |
| 4036 int consumed_chars = 0; | |
| 4037 int found = 0; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4038 int c; |
| 88365 | 4039 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4040 detect_info->checked |= CATEGORY_MASK_BIG5; |
| 88365 | 4041 /* A coding system of this category is always ASCII compatible. */ |
| 4042 src += coding->head_ascii; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4043 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4044 while (1) |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4045 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4046 src_base = src; |
| 88365 | 4047 ONE_MORE_BYTE (c); |
| 4048 if (c < 0x80) | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4049 continue; |
| 88365 | 4050 if (c >= 0xA1) |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4051 { |
| 88365 | 4052 ONE_MORE_BYTE (c); |
| 4053 if (c < 0x40 || (c >= 0x7F && c <= 0xA0)) | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4054 return 0; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4055 found = CATEGORY_MASK_BIG5; |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4056 } |
| 88365 | 4057 else |
| 4058 break; | |
| 4059 } | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4060 detect_info->rejected |= CATEGORY_MASK_BIG5; |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4061 return 0; |
| 88365 | 4062 |
| 4063 no_more_source: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4064 if (src_base < src && coding->mode & CODING_MODE_LAST_BLOCK) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4065 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4066 detect_info->rejected |= CATEGORY_MASK_BIG5; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4067 return 0; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4068 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4069 detect_info->found |= found; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4070 return 1; |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4071 } |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4072 |
| 17052 | 4073 /* See the above "GENERAL NOTES on `decode_coding_XXX ()' functions". |
| 4074 If SJIS_P is 1, decode SJIS text, else decode BIG5 test. */ | |
| 4075 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4076 static void |
| 88365 | 4077 decode_coding_sjis (coding) |
| 17052 | 4078 struct coding_system *coding; |
| 4079 { | |
| 89483 | 4080 const unsigned char *src = coding->source + coding->consumed; |
| 4081 const unsigned char *src_end = coding->source + coding->src_bytes; | |
|
59168
0345f2b10f1d
(decode_coding_XXX, decode_composition_emacs_mule)
Dan Nicolaescu <dann@ics.uci.edu>
parents:
59095
diff
changeset
|
4082 const unsigned char *src_base; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4083 int *charbuf = coding->charbuf + coding->charbuf_used; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4084 int *charbuf_end |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4085 = coding->charbuf + coding->charbuf_size - MAX_ANNOTATION_LENGTH; |
| 88365 | 4086 int consumed_chars = 0, consumed_chars_base; |
| 4087 int multibytep = coding->src_multibyte; | |
| 4088 struct charset *charset_roman, *charset_kanji, *charset_kana; | |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4089 struct charset *charset_kanji2; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4090 Lisp_Object attrs, charset_list, val; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4091 int char_offset = coding->produced_char; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4092 int last_offset = char_offset; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4093 int last_id = charset_ascii; |
| 88365 | 4094 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4095 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 4096 |
| 4097 val = charset_list; | |
| 4098 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4099 charset_kana = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4100 charset_kanji = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4101 charset_kanji2 = NILP (val) ? NULL : CHARSET_FROM_ID (XINT (XCAR (val))); |
| 88365 | 4102 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4103 while (1) |
| 17052 | 4104 { |
| 88365 | 4105 int c, c1; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4106 struct charset *charset; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4107 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4108 src_base = src; |
| 88365 | 4109 consumed_chars_base = consumed_chars; |
| 4110 | |
| 4111 if (charbuf >= charbuf_end) | |
| 4112 break; | |
| 4113 | |
| 4114 ONE_MORE_BYTE (c); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4115 if (c < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4116 goto invalid_code; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4117 if (c < 0x80) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4118 charset = charset_roman; |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4119 else if (c == 0x80 || c == 0xA0) |
|
89730
d8fcefca5cf6
(decode_coding_sjis): Check the first byte rigidly.
Kenichi Handa <handa@m17n.org>
parents:
89686
diff
changeset
|
4120 goto invalid_code; |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4121 else if (c >= 0xA1 && c <= 0xDF) |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4122 { |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4123 /* SJIS -> JISX0201-Kana */ |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4124 c &= 0x7F; |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4125 charset = charset_kana; |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4126 } |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4127 else if (c <= 0xEF) |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4128 { |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4129 /* SJIS -> JISX0208 */ |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4130 ONE_MORE_BYTE (c1); |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4131 if (c1 < 0x40 || c1 == 0x7F || c1 > 0xFC) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4132 goto invalid_code; |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4133 c = (c << 8) | c1; |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4134 SJIS_TO_JIS (c); |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4135 charset = charset_kanji; |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4136 } |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4137 else if (c <= 0xFC && charset_kanji2) |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4138 { |
|
89779
74c503490829
(decode_coding_sjis): Fix comment.
Kenichi Handa <handa@m17n.org>
parents:
89764
diff
changeset
|
4139 /* SJIS -> JISX0213-2 */ |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4140 ONE_MORE_BYTE (c1); |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4141 if (c1 < 0x40 || c1 == 0x7F || c1 > 0xFC) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4142 goto invalid_code; |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4143 c = (c << 8) | c1; |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4144 SJIS_TO_JIS2 (c); |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4145 charset = charset_kanji2; |
| 17052 | 4146 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4147 else |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4148 goto invalid_code; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4149 if (charset->id != charset_ascii |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4150 && last_id != charset->id) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4151 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4152 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4153 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4154 last_id = charset->id; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4155 last_offset = char_offset; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4156 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4157 CODING_DECODE_CHAR (coding, src, src_base, src_end, charset, c, c); |
| 88365 | 4158 *charbuf++ = c; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4159 char_offset++; |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4160 continue; |
|
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4161 |
| 88365 | 4162 invalid_code: |
| 17052 | 4163 src = src_base; |
| 88365 | 4164 consumed_chars = consumed_chars_base; |
| 4165 ONE_MORE_BYTE (c); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4166 *charbuf++ = c < 0 ? -c : BYTE8_TO_CHAR (c); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4167 char_offset++; |
| 88365 | 4168 coding->errors++; |
| 4169 } | |
| 4170 | |
| 4171 no_more_source: | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4172 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4173 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
| 88365 | 4174 coding->consumed_char += consumed_chars_base; |
| 4175 coding->consumed = src_base - coding->source; | |
| 4176 coding->charbuf_used = charbuf - coding->charbuf; | |
| 4177 } | |
| 4178 | |
| 4179 static void | |
| 4180 decode_coding_big5 (coding) | |
| 4181 struct coding_system *coding; | |
| 4182 { | |
| 89483 | 4183 const unsigned char *src = coding->source + coding->consumed; |
| 4184 const unsigned char *src_end = coding->source + coding->src_bytes; | |
| 4185 const unsigned char *src_base; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4186 int *charbuf = coding->charbuf + coding->charbuf_used; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4187 int *charbuf_end |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4188 = coding->charbuf + coding->charbuf_size - MAX_ANNOTATION_LENGTH; |
| 88365 | 4189 int consumed_chars = 0, consumed_chars_base; |
| 4190 int multibytep = coding->src_multibyte; | |
| 4191 struct charset *charset_roman, *charset_big5; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4192 Lisp_Object attrs, charset_list, val; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4193 int char_offset = coding->produced_char; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4194 int last_offset = char_offset; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4195 int last_id = charset_ascii; |
| 88365 | 4196 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4197 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 4198 val = charset_list; |
| 4199 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
| 4200 charset_big5 = CHARSET_FROM_ID (XINT (XCAR (val))); | |
| 4201 | |
| 4202 while (1) | |
| 4203 { | |
| 4204 int c, c1; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4205 struct charset *charset; |
| 88365 | 4206 |
| 4207 src_base = src; | |
| 4208 consumed_chars_base = consumed_chars; | |
| 4209 | |
| 4210 if (charbuf >= charbuf_end) | |
| 4211 break; | |
| 4212 | |
| 4213 ONE_MORE_BYTE (c); | |
| 4214 | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4215 if (c < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4216 goto invalid_code; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4217 if (c < 0x80) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4218 charset = charset_roman; |
| 88365 | 4219 else |
| 4220 { | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4221 /* BIG5 -> Big5 */ |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4222 if (c < 0xA1 || c > 0xFE) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4223 goto invalid_code; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4224 ONE_MORE_BYTE (c1); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4225 if (c1 < 0x40 || (c1 > 0x7E && c1 < 0xA1) || c1 > 0xFE) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4226 goto invalid_code; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4227 c = c << 8 | c1; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4228 charset = charset_big5; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4229 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4230 if (charset->id != charset_ascii |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4231 && last_id != charset->id) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4232 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4233 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4234 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4235 last_id = charset->id; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4236 last_offset = char_offset; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4237 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4238 CODING_DECODE_CHAR (coding, src, src_base, src_end, charset, c, c); |
| 88365 | 4239 *charbuf++ = c; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4240 char_offset++; |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4241 continue; |
|
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4242 |
| 88365 | 4243 invalid_code: |
| 17052 | 4244 src = src_base; |
| 88365 | 4245 consumed_chars = consumed_chars_base; |
| 4246 ONE_MORE_BYTE (c); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4247 *charbuf++ = c < 0 ? -c : BYTE8_TO_CHAR (c); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4248 char_offset++; |
| 88365 | 4249 coding->errors++; |
| 4250 } | |
| 4251 | |
| 4252 no_more_source: | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4253 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4254 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
| 88365 | 4255 coding->consumed_char += consumed_chars_base; |
| 4256 coding->consumed = src_base - coding->source; | |
| 4257 coding->charbuf_used = charbuf - coding->charbuf; | |
| 17052 | 4258 } |
| 4259 | |
| 4260 /* See the above "GENERAL NOTES on `encode_coding_XXX ()' functions". | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4261 This function can encode charsets `ascii', `katakana-jisx0201', |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4262 `japanese-jisx0208', `chinese-big5-1', and `chinese-big5-2'. We |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4263 are sure that all these charsets are registered as official charset |
| 17052 | 4264 (i.e. do not have extended leading-codes). Characters of other |
| 4265 charsets are produced without any encoding. If SJIS_P is 1, encode | |
| 4266 SJIS text, else encode BIG5 text. */ | |
| 4267 | |
| 88365 | 4268 static int |
| 4269 encode_coding_sjis (coding) | |
| 17052 | 4270 struct coding_system *coding; |
| 4271 { | |
| 88365 | 4272 int multibytep = coding->dst_multibyte; |
| 4273 int *charbuf = coding->charbuf; | |
| 4274 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 4275 unsigned char *dst = coding->destination + coding->produced; | |
| 4276 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 4277 int safe_room = 4; | |
| 4278 int produced_chars = 0; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4279 Lisp_Object attrs, charset_list, val; |
| 88365 | 4280 int ascii_compatible; |
| 4281 struct charset *charset_roman, *charset_kanji, *charset_kana; | |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4282 struct charset *charset_kanji2; |
| 88365 | 4283 int c; |
| 4284 | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4285 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 4286 val = charset_list; |
| 4287 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
| 4288 charset_kana = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4289 charset_kanji = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4290 charset_kanji2 = NILP (val) ? NULL : CHARSET_FROM_ID (XINT (XCAR (val))); |
| 88365 | 4291 |
| 4292 ascii_compatible = ! NILP (CODING_ATTR_ASCII_COMPAT (attrs)); | |
| 4293 | |
| 4294 while (charbuf < charbuf_end) | |
| 4295 { | |
| 4296 ASSURE_DESTINATION (safe_room); | |
| 4297 c = *charbuf++; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4298 /* Now encode the character C. */ |
| 88365 | 4299 if (ASCII_CHAR_P (c) && ascii_compatible) |
| 4300 EMIT_ONE_ASCII_BYTE (c); | |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4301 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4302 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4303 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4304 EMIT_ONE_BYTE (c); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4305 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4306 else |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4307 { |
| 88365 | 4308 unsigned code; |
| 4309 struct charset *charset = char_charset (c, charset_list, &code); | |
| 4310 | |
| 4311 if (!charset) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4312 { |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4313 if (coding->mode & CODING_MODE_SAFE_ENCODING) |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4314 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4315 code = CODING_INHIBIT_CHARACTER_SUBSTITUTION; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4316 charset = CHARSET_FROM_ID (charset_ascii); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4317 } |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4318 else |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4319 { |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4320 c = coding->default_char; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4321 charset = char_charset (c, charset_list, &code); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4322 } |
| 88365 | 4323 } |
| 4324 if (code == CHARSET_INVALID_CODE (charset)) | |
| 4325 abort (); | |
| 4326 if (charset == charset_kanji) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4327 { |
| 88365 | 4328 int c1, c2; |
| 4329 JIS_TO_SJIS (code); | |
| 4330 c1 = code >> 8, c2 = code & 0xFF; | |
| 4331 EMIT_TWO_BYTES (c1, c2); | |
| 4332 } | |
| 4333 else if (charset == charset_kana) | |
| 4334 EMIT_ONE_BYTE (code | 0x80); | |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4335 else if (charset_kanji2 && charset == charset_kanji2) |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4336 { |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4337 int c1, c2; |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4338 |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4339 c1 = code >> 8; |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4340 if (c1 == 0x21 || (c1 >= 0x23 && c1 < 0x25) |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4341 || (c1 >= 0x2C && c1 <= 0x2F) || c1 >= 0x6E) |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4342 { |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4343 JIS_TO_SJIS2 (code); |
|
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4344 c1 = code >> 8, c2 = code & 0xFF; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4345 EMIT_TWO_BYTES (c1, c2); |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4346 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4347 else |
|
89764
e3d26232ab78
(decode_coding_sjis): Handle 4th charset (typically JISX0212).
Kenichi Handa <handa@m17n.org>
parents:
89759
diff
changeset
|
4348 EMIT_ONE_ASCII_BYTE (code & 0x7F); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4349 } |
| 17052 | 4350 else |
| 88365 | 4351 EMIT_ONE_ASCII_BYTE (code & 0x7F); |
| 4352 } | |
| 4353 } | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4354 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 4355 coding->produced_char += produced_chars; |
| 4356 coding->produced = dst - coding->destination; | |
| 4357 return 0; | |
| 4358 } | |
| 4359 | |
| 4360 static int | |
| 4361 encode_coding_big5 (coding) | |
| 4362 struct coding_system *coding; | |
| 4363 { | |
| 4364 int multibytep = coding->dst_multibyte; | |
| 4365 int *charbuf = coding->charbuf; | |
| 4366 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 4367 unsigned char *dst = coding->destination + coding->produced; | |
| 4368 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 4369 int safe_room = 4; | |
| 4370 int produced_chars = 0; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4371 Lisp_Object attrs, charset_list, val; |
| 88365 | 4372 int ascii_compatible; |
| 4373 struct charset *charset_roman, *charset_big5; | |
| 4374 int c; | |
| 4375 | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4376 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 4377 val = charset_list; |
| 4378 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
| 4379 charset_big5 = CHARSET_FROM_ID (XINT (XCAR (val))); | |
| 4380 ascii_compatible = ! NILP (CODING_ATTR_ASCII_COMPAT (attrs)); | |
| 4381 | |
| 4382 while (charbuf < charbuf_end) | |
| 4383 { | |
| 4384 ASSURE_DESTINATION (safe_room); | |
| 4385 c = *charbuf++; | |
| 4386 /* Now encode the character C. */ | |
| 4387 if (ASCII_CHAR_P (c) && ascii_compatible) | |
| 4388 EMIT_ONE_ASCII_BYTE (c); | |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4389 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4390 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4391 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4392 EMIT_ONE_BYTE (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4393 } |
| 88365 | 4394 else |
| 4395 { | |
| 4396 unsigned code; | |
| 4397 struct charset *charset = char_charset (c, charset_list, &code); | |
| 4398 | |
| 4399 if (! charset) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4400 { |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4401 if (coding->mode & CODING_MODE_SAFE_ENCODING) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4402 { |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4403 code = CODING_INHIBIT_CHARACTER_SUBSTITUTION; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4404 charset = CHARSET_FROM_ID (charset_ascii); |
|
51140
94d903190cee
(ENCODE_UNSAFE_CHARACTER): Adjusted for the name change
Kenichi Handa <handa@m17n.org>
parents:
51090
diff
changeset
|
4405 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4406 else |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4407 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4408 c = coding->default_char; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4409 charset = char_charset (c, charset_list, &code); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4410 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4411 } |
| 88365 | 4412 if (code == CHARSET_INVALID_CODE (charset)) |
| 4413 abort (); | |
| 4414 if (charset == charset_big5) | |
| 4415 { | |
| 4416 int c1, c2; | |
| 4417 | |
| 4418 c1 = code >> 8, c2 = code & 0xFF; | |
| 4419 EMIT_TWO_BYTES (c1, c2); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4420 } |
| 17052 | 4421 else |
| 88365 | 4422 EMIT_ONE_ASCII_BYTE (code & 0x7F); |
| 17052 | 4423 } |
| 88365 | 4424 } |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4425 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 4426 coding->produced_char += produced_chars; |
| 4427 coding->produced = dst - coding->destination; | |
| 4428 return 0; | |
| 17052 | 4429 } |
| 4430 | |
| 4431 | |
| 88365 | 4432 /*** 10. CCL handlers ***/ |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4433 |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4434 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4435 Check if a text is encoded in a coding system of which |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4436 encoder/decoder are written in CCL program. If it is, return |
| 88365 | 4437 CATEGORY_MASK_CCL, else return 0. */ |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4438 |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
4439 static int |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4440 detect_coding_ccl (coding, detect_info) |
| 88365 | 4441 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4442 struct coding_detection_info *detect_info; |
| 88365 | 4443 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4444 const unsigned char *src = coding->source, *src_base; |
| 89483 | 4445 const unsigned char *src_end = coding->source + coding->src_bytes; |
| 88365 | 4446 int multibytep = coding->src_multibyte; |
| 4447 int consumed_chars = 0; | |
| 4448 int found = 0; | |
|
89848
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
4449 unsigned char *valids; |
| 88365 | 4450 int head_ascii = coding->head_ascii; |
| 4451 Lisp_Object attrs; | |
| 4452 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4453 detect_info->checked |= CATEGORY_MASK_CCL; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4454 |
| 88365 | 4455 coding = &coding_categories[coding_category_ccl]; |
|
89848
3edfa038a435
(detect_coding_emacs_mule): Fix counting of encoded
Kenichi Handa <handa@m17n.org>
parents:
89842
diff
changeset
|
4456 valids = CODING_CCL_VALIDS (coding); |
| 88365 | 4457 attrs = CODING_ID_ATTRS (coding->id); |
| 4458 if (! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 4459 src += head_ascii; | |
| 4460 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4461 while (1) |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4462 { |
| 88365 | 4463 int c; |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4464 |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4465 src_base = src; |
| 88365 | 4466 ONE_MORE_BYTE (c); |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4467 if (c < 0 || ! valids[c]) |
| 88365 | 4468 break; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4469 if ((valids[c] > 1)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4470 found = CATEGORY_MASK_CCL; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4471 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4472 detect_info->rejected |= CATEGORY_MASK_CCL; |
| 88365 | 4473 return 0; |
| 4474 | |
| 4475 no_more_source: | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4476 detect_info->found |= found; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4477 return 1; |
| 88365 | 4478 } |
| 4479 | |
| 4480 static void | |
| 4481 decode_coding_ccl (coding) | |
| 4482 struct coding_system *coding; | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4483 { |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
4484 const unsigned char *src = coding->source + coding->consumed; |
| 89483 | 4485 const unsigned char *src_end = coding->source + coding->src_bytes; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4486 int *charbuf = coding->charbuf + coding->charbuf_used; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4487 int *charbuf_end = coding->charbuf + coding->charbuf_size; |
| 88365 | 4488 int consumed_chars = 0; |
| 4489 int multibytep = coding->src_multibyte; | |
| 4490 struct ccl_program ccl; | |
| 4491 int source_charbuf[1024]; | |
| 4492 int source_byteidx[1024]; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4493 Lisp_Object attrs, charset_list; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4494 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4495 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 4496 setup_ccl_program (&ccl, CODING_CCL_DECODER (coding)); |
| 4497 | |
| 4498 while (src < src_end) | |
| 4499 { | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
4500 const unsigned char *p = src; |
| 88365 | 4501 int *source, *source_end; |
| 4502 int i = 0; | |
| 4503 | |
| 4504 if (multibytep) | |
| 4505 while (i < 1024 && p < src_end) | |
| 4506 { | |
| 4507 source_byteidx[i] = p - src; | |
| 4508 source_charbuf[i++] = STRING_CHAR_ADVANCE (p); | |
| 4509 } | |
| 4510 else | |
| 4511 while (i < 1024 && p < src_end) | |
| 4512 source_charbuf[i++] = *p++; | |
| 89483 | 4513 |
| 88365 | 4514 if (p == src_end && coding->mode & CODING_MODE_LAST_BLOCK) |
| 4515 ccl.last_block = 1; | |
| 4516 | |
| 4517 source = source_charbuf; | |
| 4518 source_end = source + i; | |
| 4519 while (source < source_end) | |
| 4520 { | |
| 4521 ccl_driver (&ccl, source, charbuf, | |
|
89373
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
4522 source_end - source, charbuf_end - charbuf, |
|
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
4523 charset_list); |
| 88365 | 4524 source += ccl.consumed; |
| 4525 charbuf += ccl.produced; | |
| 4526 if (ccl.status != CCL_STAT_SUSPEND_BY_DST) | |
| 4527 break; | |
| 4528 } | |
| 4529 if (source < source_end) | |
| 4530 src += source_byteidx[source - source_charbuf]; | |
| 4531 else | |
| 4532 src = p; | |
| 4533 consumed_chars += source - source_charbuf; | |
| 4534 | |
| 4535 if (ccl.status != CCL_STAT_SUSPEND_BY_SRC | |
| 4536 && ccl.status != CODING_RESULT_INSUFFICIENT_SRC) | |
| 4537 break; | |
| 4538 } | |
| 4539 | |
| 4540 switch (ccl.status) | |
| 4541 { | |
| 4542 case CCL_STAT_SUSPEND_BY_SRC: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4543 record_conversion_result (coding, CODING_RESULT_INSUFFICIENT_SRC); |
| 88365 | 4544 break; |
| 4545 case CCL_STAT_SUSPEND_BY_DST: | |
| 4546 break; | |
| 4547 case CCL_STAT_QUIT: | |
| 4548 case CCL_STAT_INVALID_CMD: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4549 record_conversion_result (coding, CODING_RESULT_INTERRUPT); |
| 88365 | 4550 break; |
| 4551 default: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4552 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 4553 break; |
| 4554 } | |
| 4555 coding->consumed_char += consumed_chars; | |
| 4556 coding->consumed = src - coding->source; | |
| 4557 coding->charbuf_used = charbuf - coding->charbuf; | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4558 } |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4559 |
| 88365 | 4560 static int |
| 4561 encode_coding_ccl (coding) | |
| 4562 struct coding_system *coding; | |
| 4563 { | |
| 4564 struct ccl_program ccl; | |
| 4565 int multibytep = coding->dst_multibyte; | |
| 4566 int *charbuf = coding->charbuf; | |
| 4567 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 4568 unsigned char *dst = coding->destination + coding->produced; | |
| 4569 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 4570 int destination_charbuf[1024]; | |
| 4571 int i, produced_chars = 0; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4572 Lisp_Object attrs, charset_list; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4573 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4574 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 4575 setup_ccl_program (&ccl, CODING_CCL_ENCODER (coding)); |
| 4576 | |
| 4577 ccl.last_block = coding->mode & CODING_MODE_LAST_BLOCK; | |
| 4578 ccl.dst_multibyte = coding->dst_multibyte; | |
| 4579 | |
|
90346
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4580 while (charbuf < charbuf_end) |
|
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4581 { |
| 88365 | 4582 ccl_driver (&ccl, charbuf, destination_charbuf, |
|
90346
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4583 charbuf_end - charbuf, 1024, charset_list); |
| 88365 | 4584 if (multibytep) |
|
90346
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4585 { |
|
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4586 ASSURE_DESTINATION (ccl.produced * 2); |
|
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4587 for (i = 0; i < ccl.produced; i++) |
|
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4588 EMIT_ONE_BYTE (destination_charbuf[i] & 0xFF); |
|
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4589 } |
| 88365 | 4590 else |
| 4591 { | |
|
90346
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4592 ASSURE_DESTINATION (ccl.produced); |
| 88365 | 4593 for (i = 0; i < ccl.produced; i++) |
| 4594 *dst++ = destination_charbuf[i] & 0xFF; | |
| 4595 produced_chars += ccl.produced; | |
| 4596 } | |
|
90346
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4597 charbuf += ccl.consumed; |
|
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4598 if (ccl.status == CCL_STAT_QUIT |
|
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4599 || ccl.status == CCL_STAT_INVALID_CMD) |
|
bba59a8cdae0
(encode_coding_ccl): Allocate destination dynamically
Kenichi Handa <handa@m17n.org>
parents:
90336
diff
changeset
|
4600 break; |
| 88365 | 4601 } |
| 4602 | |
| 4603 switch (ccl.status) | |
| 4604 { | |
| 4605 case CCL_STAT_SUSPEND_BY_SRC: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4606 record_conversion_result (coding, CODING_RESULT_INSUFFICIENT_SRC); |
| 88365 | 4607 break; |
| 4608 case CCL_STAT_SUSPEND_BY_DST: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4609 record_conversion_result (coding, CODING_RESULT_INSUFFICIENT_DST); |
| 88365 | 4610 break; |
| 4611 case CCL_STAT_QUIT: | |
| 4612 case CCL_STAT_INVALID_CMD: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4613 record_conversion_result (coding, CODING_RESULT_INTERRUPT); |
| 88365 | 4614 break; |
| 4615 default: | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4616 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 4617 break; |
| 4618 } | |
| 4619 | |
| 4620 coding->produced_char += produced_chars; | |
| 4621 coding->produced = dst - coding->destination; | |
| 4622 return 0; | |
| 4623 } | |
| 4624 | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4625 |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4626 |
| 88365 | 4627 /*** 10, 11. no-conversion handlers ***/ |
| 17052 | 4628 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4629 /* See the above "GENERAL NOTES on `decode_coding_XXX ()' functions". */ |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4630 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4631 static void |
| 88365 | 4632 decode_coding_raw_text (coding) |
| 17052 | 4633 struct coding_system *coding; |
| 4634 { | |
| 88365 | 4635 coding->chars_at_source = 1; |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
4636 coding->consumed_char = 0; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
4637 coding->consumed = 0; |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4638 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 4639 } |
| 4640 | |
| 4641 static int | |
| 4642 encode_coding_raw_text (coding) | |
| 17052 | 4643 struct coding_system *coding; |
| 88365 | 4644 { |
| 4645 int multibytep = coding->dst_multibyte; | |
| 4646 int *charbuf = coding->charbuf; | |
| 4647 int *charbuf_end = coding->charbuf + coding->charbuf_used; | |
| 4648 unsigned char *dst = coding->destination + coding->produced; | |
| 4649 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 4650 int produced_chars = 0; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4651 int c; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4652 |
| 88365 | 4653 if (multibytep) |
| 4654 { | |
| 4655 int safe_room = MAX_MULTIBYTE_LENGTH * 2; | |
| 4656 | |
| 4657 if (coding->src_multibyte) | |
| 4658 while (charbuf < charbuf_end) | |
| 4659 { | |
| 4660 ASSURE_DESTINATION (safe_room); | |
| 4661 c = *charbuf++; | |
| 4662 if (ASCII_CHAR_P (c)) | |
| 4663 EMIT_ONE_ASCII_BYTE (c); | |
| 4664 else if (CHAR_BYTE8_P (c)) | |
| 4665 { | |
| 4666 c = CHAR_TO_BYTE8 (c); | |
| 4667 EMIT_ONE_BYTE (c); | |
| 4668 } | |
| 4669 else | |
| 4670 { | |
| 4671 unsigned char str[MAX_MULTIBYTE_LENGTH], *p0 = str, *p1 = str; | |
| 4672 | |
| 4673 CHAR_STRING_ADVANCE (c, p1); | |
| 4674 while (p0 < p1) | |
|
88950
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
4675 { |
|
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
4676 EMIT_ONE_BYTE (*p0); |
|
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
4677 p0++; |
|
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
4678 } |
| 88365 | 4679 } |
| 4680 } | |
| 4681 else | |
| 4682 while (charbuf < charbuf_end) | |
| 4683 { | |
| 4684 ASSURE_DESTINATION (safe_room); | |
| 4685 c = *charbuf++; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4686 EMIT_ONE_BYTE (c); |
| 88365 | 4687 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4688 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4689 else |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4690 { |
| 88365 | 4691 if (coding->src_multibyte) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4692 { |
| 88365 | 4693 int safe_room = MAX_MULTIBYTE_LENGTH; |
| 4694 | |
| 4695 while (charbuf < charbuf_end) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4696 { |
| 88365 | 4697 ASSURE_DESTINATION (safe_room); |
| 4698 c = *charbuf++; | |
| 4699 if (ASCII_CHAR_P (c)) | |
| 4700 *dst++ = c; | |
| 4701 else if (CHAR_BYTE8_P (c)) | |
| 4702 *dst++ = CHAR_TO_BYTE8 (c); | |
| 4703 else | |
| 4704 CHAR_STRING_ADVANCE (c, dst); | |
| 4705 produced_chars++; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4706 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4707 } |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4708 else |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4709 { |
| 88365 | 4710 ASSURE_DESTINATION (charbuf_end - charbuf); |
| 4711 while (charbuf < charbuf_end && dst < dst_end) | |
| 4712 *dst++ = *charbuf++; | |
| 4713 produced_chars = dst - (coding->destination + coding->dst_bytes); | |
| 89483 | 4714 } |
| 88365 | 4715 } |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4716 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 4717 coding->produced_char += produced_chars; |
| 4718 coding->produced = dst - coding->destination; | |
| 4719 return 0; | |
| 4720 } | |
| 4721 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4722 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4723 Check if a text is encoded in a charset-based coding system. If it |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4724 is, return 1, else return 0. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4725 |
| 88365 | 4726 static int |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4727 detect_coding_charset (coding, detect_info) |
| 88365 | 4728 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4729 struct coding_detection_info *detect_info; |
| 88365 | 4730 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4731 const unsigned char *src = coding->source, *src_base; |
| 89483 | 4732 const unsigned char *src_end = coding->source + coding->src_bytes; |
| 88365 | 4733 int multibytep = coding->src_multibyte; |
| 4734 int consumed_chars = 0; | |
| 4735 Lisp_Object attrs, valids; | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
4736 int found = 0; |
|
90651
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4737 int head_ascii = coding->head_ascii; |
| 88365 | 4738 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4739 detect_info->checked |= CATEGORY_MASK_CHARSET; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4740 |
| 88365 | 4741 coding = &coding_categories[coding_category_charset]; |
| 4742 attrs = CODING_ID_ATTRS (coding->id); | |
| 4743 valids = AREF (attrs, coding_attr_charset_valids); | |
| 4744 | |
| 4745 if (! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
|
90651
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4746 src += head_ascii; |
| 88365 | 4747 |
| 4748 while (1) | |
| 4749 { | |
| 4750 int c; | |
|
90651
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4751 Lisp_Object val; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4752 struct charset *charset; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4753 int dim, idx; |
| 88365 | 4754 |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4755 src_base = src; |
| 88365 | 4756 ONE_MORE_BYTE (c); |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4757 if (c < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4758 continue; |
|
90651
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4759 val = AREF (valids, c); |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4760 if (NILP (val)) |
| 88365 | 4761 break; |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
4762 if (c >= 0x80) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4763 found = CATEGORY_MASK_CHARSET; |
|
90651
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4764 if (INTEGERP (val)) |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4765 { |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4766 charset = CHARSET_FROM_ID (XFASTINT (val)); |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4767 dim = CHARSET_DIMENSION (charset); |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4768 for (idx = 1; idx < dim; idx++) |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4769 { |
|
90651
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4770 if (src == src_end) |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4771 goto too_short; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4772 ONE_MORE_BYTE (c); |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4773 if (c < charset->code_space[(dim - 1 - idx) * 2] |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4774 || c > charset->code_space[(dim - 1 - idx) * 2 + 1]) |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4775 break; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4776 } |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4777 if (idx < dim) |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4778 break; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4779 } |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4780 else |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4781 { |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4782 idx = 1; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4783 for (; CONSP (val); val = XCDR (val)) |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4784 { |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4785 charset = CHARSET_FROM_ID (XFASTINT (XCAR (val))); |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4786 dim = CHARSET_DIMENSION (charset); |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4787 while (idx < dim) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4788 { |
|
90651
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4789 if (src == src_end) |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4790 goto too_short; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4791 ONE_MORE_BYTE (c); |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4792 if (c < charset->code_space[(dim - 1 - idx) * 4] |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4793 || c > charset->code_space[(dim - 1 - idx) * 4 + 1]) |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4794 break; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4795 idx++; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4796 } |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4797 if (idx == dim) |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4798 { |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4799 val = Qnil; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4800 break; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4801 } |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4802 } |
|
90651
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4803 if (CONSP (val)) |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4804 break; |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4805 } |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4806 } |
|
23c1467f8640
(detect_coding_charset): Fix detection of multi-byte
Kenichi Handa <handa@m17n.org>
parents:
90599
diff
changeset
|
4807 too_short: |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4808 detect_info->rejected |= CATEGORY_MASK_CHARSET; |
| 88365 | 4809 return 0; |
| 4810 | |
| 4811 no_more_source: | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4812 detect_info->found |= found; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4813 return 1; |
| 88365 | 4814 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4815 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4816 static void |
| 88365 | 4817 decode_coding_charset (coding) |
| 17052 | 4818 struct coding_system *coding; |
| 88365 | 4819 { |
| 89483 | 4820 const unsigned char *src = coding->source + coding->consumed; |
| 4821 const unsigned char *src_end = coding->source + coding->src_bytes; | |
|
46548
cb1914307488
(encode_eol, detect_coding, detect_eol):
Ken Raeburn <raeburn@raeburn.org>
parents:
46462
diff
changeset
|
4822 const unsigned char *src_base; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4823 int *charbuf = coding->charbuf + coding->charbuf_used; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4824 int *charbuf_end |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4825 = coding->charbuf + coding->charbuf_size - MAX_ANNOTATION_LENGTH; |
| 88365 | 4826 int consumed_chars = 0, consumed_chars_base; |
| 4827 int multibytep = coding->src_multibyte; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4828 Lisp_Object attrs, charset_list, valids; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4829 int char_offset = coding->produced_char; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4830 int last_offset = char_offset; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4831 int last_id = charset_ascii; |
| 88365 | 4832 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4833 CODING_GET_INFO (coding, attrs, charset_list); |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4834 valids = AREF (attrs, coding_attr_charset_valids); |
| 88365 | 4835 |
| 4836 while (1) | |
| 4837 { | |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4838 int c; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4839 Lisp_Object val; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4840 struct charset *charset; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4841 int dim; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4842 int len = 1; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4843 unsigned code; |
| 88365 | 4844 |
|
29093
176708661b08
(encode_eol): Fix a bug of DOS style EOL encoding.
Kenichi Handa <handa@m17n.org>
parents:
29005
diff
changeset
|
4845 src_base = src; |
| 88365 | 4846 consumed_chars_base = consumed_chars; |
| 4847 | |
| 4848 if (charbuf >= charbuf_end) | |
| 4849 break; | |
| 4850 | |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4851 ONE_MORE_BYTE (c); |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4852 if (c < 0) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4853 goto invalid_code; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4854 code = c; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4855 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4856 val = AREF (valids, c); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4857 if (NILP (val)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4858 goto invalid_code; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4859 if (INTEGERP (val)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4860 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4861 charset = CHARSET_FROM_ID (XFASTINT (val)); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4862 dim = CHARSET_DIMENSION (charset); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4863 while (len < dim) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4864 { |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4865 ONE_MORE_BYTE (c); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4866 code = (code << 8) | c; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4867 len++; |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4868 } |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4869 CODING_DECODE_CHAR (coding, src, src_base, src_end, |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4870 charset, code, c); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4871 } |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4872 else |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4873 { |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4874 /* VAL is a list of charset IDs. It is assured that the |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4875 list is sorted by charset dimensions (smaller one |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4876 comes first). */ |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4877 while (CONSP (val)) |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4878 { |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4879 charset = CHARSET_FROM_ID (XFASTINT (XCAR (val))); |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4880 dim = CHARSET_DIMENSION (charset); |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
4881 while (len < dim) |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4882 { |
|
88598
b88195f69856
(decode_coding_charset): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88597
diff
changeset
|
4883 ONE_MORE_BYTE (c); |
|
b88195f69856
(decode_coding_charset): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88597
diff
changeset
|
4884 code = (code << 8) | c; |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
4885 len++; |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4886 } |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4887 CODING_DECODE_CHAR (coding, src, src_base, |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4888 src_end, charset, code, c); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4889 if (c >= 0) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4890 break; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4891 val = XCDR (val); |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4892 } |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4893 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4894 if (c < 0) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4895 goto invalid_code; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4896 if (charset->id != charset_ascii |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4897 && last_id != charset->id) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4898 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4899 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4900 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4901 last_id = charset->id; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4902 last_offset = char_offset; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4903 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4904 |
| 88365 | 4905 *charbuf++ = c; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4906 char_offset++; |
| 88365 | 4907 continue; |
| 4908 | |
| 4909 invalid_code: | |
| 4910 src = src_base; | |
| 4911 consumed_chars = consumed_chars_base; | |
| 4912 ONE_MORE_BYTE (c); | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4913 *charbuf++ = c < 0 ? -c : ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4914 char_offset++; |
| 88365 | 4915 coding->errors++; |
| 4916 } | |
| 4917 | |
| 4918 no_more_source: | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
4919 if (last_id != charset_ascii) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
4920 ADD_CHARSET_DATA (charbuf, char_offset - last_offset, last_id); |
| 88365 | 4921 coding->consumed_char += consumed_chars_base; |
| 4922 coding->consumed = src_base - coding->source; | |
| 4923 coding->charbuf_used = charbuf - coding->charbuf; | |
| 4924 } | |
| 4925 | |
| 4926 static int | |
| 4927 encode_coding_charset (coding) | |
| 4928 struct coding_system *coding; | |
| 4929 { | |
| 4930 int multibytep = coding->dst_multibyte; | |
| 4931 int *charbuf = coding->charbuf; | |
| 4932 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 4933 unsigned char *dst = coding->destination + coding->produced; | |
| 4934 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 4935 int safe_room = MAX_MULTIBYTE_LENGTH; | |
| 4936 int produced_chars = 0; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4937 Lisp_Object attrs, charset_list; |
| 88365 | 4938 int ascii_compatible; |
| 4939 int c; | |
| 4940 | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
4941 CODING_GET_INFO (coding, attrs, charset_list); |
| 88365 | 4942 ascii_compatible = ! NILP (CODING_ATTR_ASCII_COMPAT (attrs)); |
| 4943 | |
| 4944 while (charbuf < charbuf_end) | |
| 4945 { | |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4946 struct charset *charset; |
| 88365 | 4947 unsigned code; |
| 89483 | 4948 |
| 88365 | 4949 ASSURE_DESTINATION (safe_room); |
| 4950 c = *charbuf++; | |
| 4951 if (ascii_compatible && ASCII_CHAR_P (c)) | |
| 4952 EMIT_ONE_ASCII_BYTE (c); | |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4953 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4954 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4955 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4956 EMIT_ONE_BYTE (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4957 } |
| 88365 | 4958 else |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4959 { |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4960 charset = char_charset (c, charset_list, &code); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4961 if (charset) |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4962 { |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4963 if (CHARSET_DIMENSION (charset) == 1) |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4964 EMIT_ONE_BYTE (code); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4965 else if (CHARSET_DIMENSION (charset) == 2) |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4966 EMIT_TWO_BYTES (code >> 8, code & 0xFF); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4967 else if (CHARSET_DIMENSION (charset) == 3) |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4968 EMIT_THREE_BYTES (code >> 16, (code >> 8) & 0xFF, code & 0xFF); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4969 else |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4970 EMIT_FOUR_BYTES (code >> 24, (code >> 16) & 0xFF, |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4971 (code >> 8) & 0xFF, code & 0xFF); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4972 } |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4973 else |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4974 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4975 if (coding->mode & CODING_MODE_SAFE_ENCODING) |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4976 c = CODING_INHIBIT_CHARACTER_SUBSTITUTION; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4977 else |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4978 c = coding->default_char; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4979 EMIT_ONE_BYTE (c); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4980 } |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4981 } |
| 88365 | 4982 } |
| 4983 | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
4984 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 4985 coding->produced_char += produced_chars; |
| 4986 coding->produced = dst - coding->destination; | |
| 4987 return 0; | |
| 17052 | 4988 } |
| 4989 | |
| 4990 | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4991 /*** 7. C library functions ***/ |
| 17052 | 4992 |
| 88365 | 4993 /* Setup coding context CODING from information about CODING_SYSTEM. |
| 4994 If CODING_SYSTEM is nil, `no-conversion' is assumed. If | |
| 4995 CODING_SYSTEM is invalid, signal an error. */ | |
| 4996 | |
| 4997 void | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
4998 setup_coding_system (coding_system, coding) |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
4999 Lisp_Object coding_system; |
| 17052 | 5000 struct coding_system *coding; |
| 5001 { | |
| 88365 | 5002 Lisp_Object attrs; |
| 5003 Lisp_Object eol_type; | |
| 5004 Lisp_Object coding_type; | |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
5005 Lisp_Object val; |
| 17052 | 5006 |
|
24460
be35d27a4bfb
(setup_coding_system): Check for CODING_SYSTEM = nil.
Kenichi Handa <handa@m17n.org>
parents:
24425
diff
changeset
|
5007 if (NILP (coding_system)) |
|
90011
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
5008 coding_system = Qundecided; |
| 88365 | 5009 |
| 5010 CHECK_CODING_SYSTEM_GET_ID (coding_system, coding->id); | |
| 5011 | |
| 5012 attrs = CODING_ID_ATTRS (coding->id); | |
| 5013 eol_type = CODING_ID_EOL_TYPE (coding->id); | |
| 5014 | |
| 5015 coding->mode = 0; | |
| 5016 coding->head_ascii = -1; | |
| 17052 | 5017 if (VECTORP (eol_type)) |
|
90587
fe721cfad011
(setup_coding_system): Fix setting of
Kenichi Handa <handa@m17n.org>
parents:
90573
diff
changeset
|
5018 coding->common_flags = (CODING_REQUIRE_DECODING_MASK |
|
fe721cfad011
(setup_coding_system): Fix setting of
Kenichi Handa <handa@m17n.org>
parents:
90573
diff
changeset
|
5019 | CODING_REQUIRE_DETECTION_MASK); |
|
fe721cfad011
(setup_coding_system): Fix setting of
Kenichi Handa <handa@m17n.org>
parents:
90573
diff
changeset
|
5020 else if (! EQ (eol_type, Qunix)) |
|
fe721cfad011
(setup_coding_system): Fix setting of
Kenichi Handa <handa@m17n.org>
parents:
90573
diff
changeset
|
5021 coding->common_flags = (CODING_REQUIRE_DECODING_MASK |
|
fe721cfad011
(setup_coding_system): Fix setting of
Kenichi Handa <handa@m17n.org>
parents:
90573
diff
changeset
|
5022 | CODING_REQUIRE_ENCODING_MASK); |
|
fe721cfad011
(setup_coding_system): Fix setting of
Kenichi Handa <handa@m17n.org>
parents:
90573
diff
changeset
|
5023 else |
|
fe721cfad011
(setup_coding_system): Fix setting of
Kenichi Handa <handa@m17n.org>
parents:
90573
diff
changeset
|
5024 coding->common_flags = 0; |
|
89448
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
5025 if (! NILP (CODING_ATTR_POST_READ (attrs))) |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
5026 coding->common_flags |= CODING_REQUIRE_DECODING_MASK; |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
5027 if (! NILP (CODING_ATTR_PRE_WRITE (attrs))) |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
5028 coding->common_flags |= CODING_REQUIRE_ENCODING_MASK; |
| 89483 | 5029 if (! NILP (CODING_ATTR_FOR_UNIBYTE (attrs))) |
| 5030 coding->common_flags |= CODING_FOR_UNIBYTE_MASK; | |
| 88365 | 5031 |
| 5032 val = CODING_ATTR_SAFE_CHARSETS (attrs); | |
| 89483 | 5033 coding->max_charset_id = SCHARS (val) - 1; |
| 5034 coding->safe_charsets = (char *) SDATA (val); | |
| 88365 | 5035 coding->default_char = XINT (CODING_ATTR_DEFAULT_CHAR (attrs)); |
| 5036 | |
| 5037 coding_type = CODING_ATTR_TYPE (attrs); | |
| 5038 if (EQ (coding_type, Qundecided)) | |
| 5039 { | |
| 5040 coding->detector = NULL; | |
| 5041 coding->decoder = decode_coding_raw_text; | |
| 5042 coding->encoder = encode_coding_raw_text; | |
| 5043 coding->common_flags |= CODING_REQUIRE_DETECTION_MASK; | |
| 5044 } | |
| 5045 else if (EQ (coding_type, Qiso_2022)) | |
| 5046 { | |
| 5047 int i; | |
| 5048 int flags = XINT (AREF (attrs, coding_attr_iso_flags)); | |
| 5049 | |
| 5050 /* Invoke graphic register 0 to plane 0. */ | |
| 5051 CODING_ISO_INVOCATION (coding, 0) = 0; | |
| 5052 /* Invoke graphic register 1 to plane 1 if we can use 8-bit. */ | |
| 5053 CODING_ISO_INVOCATION (coding, 1) | |
| 5054 = (flags & CODING_ISO_FLAG_SEVEN_BITS ? -1 : 1); | |
| 5055 /* Setup the initial status of designation. */ | |
| 5056 for (i = 0; i < 4; i++) | |
| 5057 CODING_ISO_DESIGNATION (coding, i) = CODING_ISO_INITIAL (coding, i); | |
| 5058 /* Not single shifting initially. */ | |
| 5059 CODING_ISO_SINGLE_SHIFTING (coding) = 0; | |
| 5060 /* Beginning of buffer should also be regarded as bol. */ | |
| 5061 CODING_ISO_BOL (coding) = 1; | |
| 5062 coding->detector = detect_coding_iso_2022; | |
| 5063 coding->decoder = decode_coding_iso_2022; | |
| 5064 coding->encoder = encode_coding_iso_2022; | |
| 5065 if (flags & CODING_ISO_FLAG_SAFE) | |
| 5066 coding->mode |= CODING_MODE_SAFE_ENCODING; | |
|
20227
71008f909642
(setup_coding_system): Initialize common_flags member
Kenichi Handa <handa@m17n.org>
parents:
20150
diff
changeset
|
5067 coding->common_flags |
| 88365 | 5068 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK |
| 5069 | CODING_REQUIRE_FLUSHING_MASK); | |
| 5070 if (flags & CODING_ISO_FLAG_COMPOSITION) | |
| 5071 coding->common_flags |= CODING_ANNOTATE_COMPOSITION_MASK; | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5072 if (flags & CODING_ISO_FLAG_DESIGNATION) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5073 coding->common_flags |= CODING_ANNOTATE_CHARSET_MASK; |
| 88365 | 5074 if (flags & CODING_ISO_FLAG_FULL_SUPPORT) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5075 { |
| 88365 | 5076 setup_iso_safe_charsets (attrs); |
| 5077 val = CODING_ATTR_SAFE_CHARSETS (attrs); | |
| 89483 | 5078 coding->max_charset_id = SCHARS (val) - 1; |
| 5079 coding->safe_charsets = (char *) SDATA (val); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5080 } |
| 88365 | 5081 CODING_ISO_FLAGS (coding) = flags; |
| 5082 } | |
| 5083 else if (EQ (coding_type, Qcharset)) | |
| 5084 { | |
| 5085 coding->detector = detect_coding_charset; | |
| 5086 coding->decoder = decode_coding_charset; | |
| 5087 coding->encoder = encode_coding_charset; | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
5088 coding->common_flags |
| 88365 | 5089 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); |
| 5090 } | |
| 5091 else if (EQ (coding_type, Qutf_8)) | |
| 5092 { | |
| 5093 coding->detector = detect_coding_utf_8; | |
| 5094 coding->decoder = decode_coding_utf_8; | |
| 5095 coding->encoder = encode_coding_utf_8; | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
5096 coding->common_flags |
| 88365 | 5097 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); |
| 5098 } | |
| 5099 else if (EQ (coding_type, Qutf_16)) | |
| 5100 { | |
| 5101 val = AREF (attrs, coding_attr_utf_16_bom); | |
| 5102 CODING_UTF_16_BOM (coding) = (CONSP (val) ? utf_16_detect_bom | |
| 5103 : EQ (val, Qt) ? utf_16_with_bom | |
| 5104 : utf_16_without_bom); | |
| 5105 val = AREF (attrs, coding_attr_utf_16_endian); | |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5106 CODING_UTF_16_ENDIAN (coding) = (EQ (val, Qbig) ? utf_16_big_endian |
| 88365 | 5107 : utf_16_little_endian); |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
5108 CODING_UTF_16_SURROGATE (coding) = 0; |
| 88365 | 5109 coding->detector = detect_coding_utf_16; |
| 5110 coding->decoder = decode_coding_utf_16; | |
| 5111 coding->encoder = encode_coding_utf_16; | |
|
20227
71008f909642
(setup_coding_system): Initialize common_flags member
Kenichi Handa <handa@m17n.org>
parents:
20150
diff
changeset
|
5112 coding->common_flags |
| 88365 | 5113 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5114 if (CODING_UTF_16_BOM (coding) == utf_16_detect_bom) |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5115 coding->common_flags |= CODING_REQUIRE_DETECTION_MASK; |
| 88365 | 5116 } |
| 5117 else if (EQ (coding_type, Qccl)) | |
| 5118 { | |
| 5119 coding->detector = detect_coding_ccl; | |
| 5120 coding->decoder = decode_coding_ccl; | |
| 5121 coding->encoder = encode_coding_ccl; | |
|
20227
71008f909642
(setup_coding_system): Initialize common_flags member
Kenichi Handa <handa@m17n.org>
parents:
20150
diff
changeset
|
5122 coding->common_flags |
| 88365 | 5123 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK |
| 5124 | CODING_REQUIRE_FLUSHING_MASK); | |
| 5125 } | |
| 5126 else if (EQ (coding_type, Qemacs_mule)) | |
| 5127 { | |
| 5128 coding->detector = detect_coding_emacs_mule; | |
| 5129 coding->decoder = decode_coding_emacs_mule; | |
| 5130 coding->encoder = encode_coding_emacs_mule; | |
|
20227
71008f909642
(setup_coding_system): Initialize common_flags member
Kenichi Handa <handa@m17n.org>
parents:
20150
diff
changeset
|
5131 coding->common_flags |
| 88365 | 5132 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); |
| 5133 if (! NILP (AREF (attrs, coding_attr_emacs_mule_full)) | |
| 5134 && ! EQ (CODING_ATTR_CHARSET_LIST (attrs), Vemacs_mule_charset_list)) | |
| 5135 { | |
| 5136 Lisp_Object tail, safe_charsets; | |
| 5137 int max_charset_id = 0; | |
| 5138 | |
| 5139 for (tail = Vemacs_mule_charset_list; CONSP (tail); | |
| 5140 tail = XCDR (tail)) | |
| 5141 if (max_charset_id < XFASTINT (XCAR (tail))) | |
| 5142 max_charset_id = XFASTINT (XCAR (tail)); | |
| 5143 safe_charsets = Fmake_string (make_number (max_charset_id + 1), | |
| 5144 make_number (255)); | |
| 5145 for (tail = Vemacs_mule_charset_list; CONSP (tail); | |
| 5146 tail = XCDR (tail)) | |
| 89483 | 5147 SSET (safe_charsets, XFASTINT (XCAR (tail)), 0); |
| 88365 | 5148 coding->max_charset_id = max_charset_id; |
| 89483 | 5149 coding->safe_charsets = (char *) SDATA (safe_charsets); |
| 88365 | 5150 } |
| 5151 } | |
| 5152 else if (EQ (coding_type, Qshift_jis)) | |
| 5153 { | |
| 5154 coding->detector = detect_coding_sjis; | |
| 5155 coding->decoder = decode_coding_sjis; | |
| 5156 coding->encoder = encode_coding_sjis; | |
| 5157 coding->common_flags | |
| 5158 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); | |
| 5159 } | |
| 5160 else if (EQ (coding_type, Qbig5)) | |
| 5161 { | |
| 5162 coding->detector = detect_coding_big5; | |
| 5163 coding->decoder = decode_coding_big5; | |
| 5164 coding->encoder = encode_coding_big5; | |
|
20227
71008f909642
(setup_coding_system): Initialize common_flags member
Kenichi Handa <handa@m17n.org>
parents:
20150
diff
changeset
|
5165 coding->common_flags |
| 88365 | 5166 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); |
| 5167 } | |
| 5168 else /* EQ (coding_type, Qraw_text) */ | |
| 5169 { | |
| 5170 coding->detector = NULL; | |
| 5171 coding->decoder = decode_coding_raw_text; | |
| 5172 coding->encoder = encode_coding_raw_text; | |
|
89933
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
5173 if (! EQ (eol_type, Qunix)) |
|
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
5174 { |
|
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
5175 coding->common_flags |= CODING_REQUIRE_DECODING_MASK; |
|
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
5176 if (! VECTORP (eol_type)) |
|
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
5177 coding->common_flags |= CODING_REQUIRE_ENCODING_MASK; |
|
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
5178 } |
|
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
5179 |
| 88365 | 5180 } |
| 5181 | |
|
22616
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
5182 return; |
|
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
5183 } |
|
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
5184 |
|
90061
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5185 /* Return a list of charsets supported by CODING. */ |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5186 |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5187 Lisp_Object |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5188 coding_charset_list (coding) |
| 26847 | 5189 struct coding_system *coding; |
| 5190 { | |
|
90214
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
5191 Lisp_Object attrs, charset_list; |
|
90061
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5192 |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5193 CODING_GET_INFO (coding, attrs, charset_list); |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5194 if (EQ (CODING_ATTR_TYPE (attrs), Qiso_2022)) |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5195 { |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5196 int flags = XINT (AREF (attrs, coding_attr_iso_flags)); |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5197 |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5198 if (flags & CODING_ISO_FLAG_FULL_SUPPORT) |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5199 charset_list = Viso_2022_charset_list; |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5200 } |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5201 else if (EQ (CODING_ATTR_TYPE (attrs), Qemacs_mule)) |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5202 { |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5203 charset_list = Vemacs_mule_charset_list; |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5204 } |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5205 return charset_list; |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5206 } |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5207 |
|
48210be97b12
Cancel the change done in HEAD on 2004-11-30.
Kenichi Handa <handa@m17n.org>
parents:
90054
diff
changeset
|
5208 |
| 88365 | 5209 /* Return raw-text or one of its subsidiaries that has the same |
| 5210 eol_type as CODING-SYSTEM. */ | |
| 5211 | |
| 5212 Lisp_Object | |
| 5213 raw_text_coding_system (coding_system) | |
| 5214 Lisp_Object coding_system; | |
| 26847 | 5215 { |
|
88430
6418a272b97e
* coding.c: Delete unused variables.
Kenichi Handa <handa@m17n.org>
parents:
88365
diff
changeset
|
5216 Lisp_Object spec, attrs; |
| 88365 | 5217 Lisp_Object eol_type, raw_text_eol_type; |
| 5218 | |
|
89462
4e359ebf3984
(decode_coding_iso_2022): Fix handling of invalid
Kenichi Handa <handa@m17n.org>
parents:
89448
diff
changeset
|
5219 if (NILP (coding_system)) |
|
4e359ebf3984
(decode_coding_iso_2022): Fix handling of invalid
Kenichi Handa <handa@m17n.org>
parents:
89448
diff
changeset
|
5220 return Qraw_text; |
| 88365 | 5221 spec = CODING_SYSTEM_SPEC (coding_system); |
| 5222 attrs = AREF (spec, 0); | |
| 89483 | 5223 |
| 88365 | 5224 if (EQ (CODING_ATTR_TYPE (attrs), Qraw_text)) |
| 5225 return coding_system; | |
| 5226 | |
| 5227 eol_type = AREF (spec, 2); | |
| 5228 if (VECTORP (eol_type)) | |
| 5229 return Qraw_text; | |
| 5230 spec = CODING_SYSTEM_SPEC (Qraw_text); | |
| 5231 raw_text_eol_type = AREF (spec, 2); | |
| 5232 return (EQ (eol_type, Qunix) ? AREF (raw_text_eol_type, 0) | |
| 5233 : EQ (eol_type, Qdos) ? AREF (raw_text_eol_type, 1) | |
| 5234 : AREF (raw_text_eol_type, 2)); | |
| 26847 | 5235 } |
| 5236 | |
| 88365 | 5237 |
| 5238 /* If CODING_SYSTEM doesn't specify end-of-line format but PARENT | |
| 5239 does, return one of the subsidiary that has the same eol-spec as | |
|
90394
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5240 PARENT. Otherwise, return CODING_SYSTEM. If PARENT is nil, |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5241 inherit end-of-line format from the system's setting |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5242 (system_eol_type). */ |
| 88365 | 5243 |
| 5244 Lisp_Object | |
| 5245 coding_inherit_eol_type (coding_system, parent) | |
| 88473 | 5246 Lisp_Object coding_system, parent; |
|
22616
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
5247 { |
|
89545
4f394eed6ff2
(inhibit_pre_post_conversion): Removed (unused).
Dave Love <fx@gnu.org>
parents:
89519
diff
changeset
|
5248 Lisp_Object spec, eol_type; |
| 88365 | 5249 |
|
89462
4e359ebf3984
(decode_coding_iso_2022): Fix handling of invalid
Kenichi Handa <handa@m17n.org>
parents:
89448
diff
changeset
|
5250 if (NILP (coding_system)) |
|
4e359ebf3984
(decode_coding_iso_2022): Fix handling of invalid
Kenichi Handa <handa@m17n.org>
parents:
89448
diff
changeset
|
5251 coding_system = Qraw_text; |
| 88365 | 5252 spec = CODING_SYSTEM_SPEC (coding_system); |
| 5253 eol_type = AREF (spec, 2); | |
|
90394
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5254 if (VECTORP (eol_type)) |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5255 { |
| 88365 | 5256 Lisp_Object parent_eol_type; |
| 5257 | |
|
90394
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5258 if (! NILP (parent)) |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5259 { |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5260 Lisp_Object parent_spec; |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5261 |
|
90587
fe721cfad011
(setup_coding_system): Fix setting of
Kenichi Handa <handa@m17n.org>
parents:
90573
diff
changeset
|
5262 parent_spec = CODING_SYSTEM_SPEC (parent); |
|
90394
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5263 parent_eol_type = AREF (parent_spec, 2); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5264 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5265 else |
|
90394
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
5266 parent_eol_type = system_eol_type; |
| 88365 | 5267 if (EQ (parent_eol_type, Qunix)) |
| 5268 coding_system = AREF (eol_type, 0); | |
| 5269 else if (EQ (parent_eol_type, Qdos)) | |
| 5270 coding_system = AREF (eol_type, 1); | |
| 5271 else if (EQ (parent_eol_type, Qmac)) | |
| 5272 coding_system = AREF (eol_type, 2); | |
| 5273 } | |
| 5274 return coding_system; | |
|
22616
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
5275 } |
|
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
5276 |
| 17052 | 5277 /* Emacs has a mechanism to automatically detect a coding system if it |
| 5278 is one of Emacs' internal format, ISO2022, SJIS, and BIG5. But, | |
| 5279 it's impossible to distinguish some coding systems accurately | |
| 5280 because they use the same range of codes. So, at first, coding | |
| 5281 systems are categorized into 7, those are: | |
| 5282 | |
|
17835
f36ffb6f1208
Name change through the code:
Kenichi Handa <handa@m17n.org>
parents:
17725
diff
changeset
|
5283 o coding-category-emacs-mule |
| 17052 | 5284 |
| 5285 The category for a coding system which has the same code range | |
| 5286 as Emacs' internal format. Assigned the coding-system (Lisp | |
|
17835
f36ffb6f1208
Name change through the code:
Kenichi Handa <handa@m17n.org>
parents:
17725
diff
changeset
|
5287 symbol) `emacs-mule' by default. |
| 17052 | 5288 |
| 5289 o coding-category-sjis | |
| 5290 | |
| 5291 The category for a coding system which has the same code range | |
| 5292 as SJIS. Assigned the coding-system (Lisp | |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5293 symbol) `japanese-shift-jis' by default. |
| 17052 | 5294 |
| 5295 o coding-category-iso-7 | |
| 5296 | |
| 5297 The category for a coding system which has the same code range | |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5298 as ISO2022 of 7-bit environment. This doesn't use any locking |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5299 shift and single shift functions. This can encode/decode all |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5300 charsets. Assigned the coding-system (Lisp symbol) |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5301 `iso-2022-7bit' by default. |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5302 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5303 o coding-category-iso-7-tight |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5304 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5305 Same as coding-category-iso-7 except that this can |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5306 encode/decode only the specified charsets. |
| 17052 | 5307 |
| 5308 o coding-category-iso-8-1 | |
| 5309 | |
| 5310 The category for a coding system which has the same code range | |
| 5311 as ISO2022 of 8-bit environment and graphic plane 1 used only | |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5312 for DIMENSION1 charset. This doesn't use any locking shift |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5313 and single shift functions. Assigned the coding-system (Lisp |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5314 symbol) `iso-latin-1' by default. |
| 17052 | 5315 |
| 5316 o coding-category-iso-8-2 | |
| 5317 | |
| 5318 The category for a coding system which has the same code range | |
| 5319 as ISO2022 of 8-bit environment and graphic plane 1 used only | |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5320 for DIMENSION2 charset. This doesn't use any locking shift |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5321 and single shift functions. Assigned the coding-system (Lisp |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5322 symbol) `japanese-iso-8bit' by default. |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5323 |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5324 o coding-category-iso-7-else |
| 17052 | 5325 |
| 5326 The category for a coding system which has the same code range | |
| 88365 | 5327 as ISO2022 of 7-bit environemnt but uses locking shift or |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5328 single shift functions. Assigned the coding-system (Lisp |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5329 symbol) `iso-2022-7bit-lock' by default. |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5330 |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5331 o coding-category-iso-8-else |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5332 |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5333 The category for a coding system which has the same code range |
| 88365 | 5334 as ISO2022 of 8-bit environemnt but uses locking shift or |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5335 single shift functions. Assigned the coding-system (Lisp |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
5336 symbol) `iso-2022-8bit-ss2' by default. |
| 17052 | 5337 |
| 5338 o coding-category-big5 | |
| 5339 | |
| 5340 The category for a coding system which has the same code range | |
| 5341 as BIG5. Assigned the coding-system (Lisp symbol) | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
5342 `cn-big5' by default. |
| 17052 | 5343 |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5344 o coding-category-utf-8 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5345 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5346 The category for a coding system which has the same code range |
| 54303 | 5347 as UTF-8 (cf. RFC3629). Assigned the coding-system (Lisp |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5348 symbol) `utf-8' by default. |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5349 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5350 o coding-category-utf-16-be |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5351 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5352 The category for a coding system in which a text has an |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5353 Unicode signature (cf. Unicode Standard) in the order of BIG |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5354 endian at the head. Assigned the coding-system (Lisp symbol) |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5355 `utf-16-be' by default. |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5356 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5357 o coding-category-utf-16-le |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5358 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5359 The category for a coding system in which a text has an |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5360 Unicode signature (cf. Unicode Standard) in the order of |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5361 LITTLE endian at the head. Assigned the coding-system (Lisp |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5362 symbol) `utf-16-le' by default. |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5363 |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
5364 o coding-category-ccl |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
5365 |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
5366 The category for a coding system of which encoder/decoder is |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
5367 written in CCL programs. The default value is nil, i.e., no |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
5368 coding system is assigned. |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
5369 |
| 17052 | 5370 o coding-category-binary |
| 5371 | |
| 5372 The category for a coding system not categorized in any of the | |
| 5373 above. Assigned the coding-system (Lisp symbol) | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
5374 `no-conversion' by default. |
| 17052 | 5375 |
| 5376 Each of them is a Lisp symbol and the value is an actual | |
| 88365 | 5377 `coding-system's (this is also a Lisp symbol) assigned by a user. |
| 17052 | 5378 What Emacs does actually is to detect a category of coding system. |
| 5379 Then, it uses a `coding-system' assigned to it. If Emacs can't | |
| 88365 | 5380 decide only one possible category, it selects a category of the |
| 17052 | 5381 highest priority. Priorities of categories are also specified by a |
| 5382 user in a Lisp variable `coding-category-list'. | |
| 5383 | |
| 5384 */ | |
| 5385 | |
| 88365 | 5386 #define EOL_SEEN_NONE 0 |
| 5387 #define EOL_SEEN_LF 1 | |
| 5388 #define EOL_SEEN_CR 2 | |
| 5389 #define EOL_SEEN_CRLF 4 | |
| 17052 | 5390 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5391 /* Detect how end-of-line of a text of length SRC_BYTES pointed by |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5392 SOURCE is encoded. If CATEGORY is one of |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5393 coding_category_utf_16_XXXX, assume that CR and LF are encoded by |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5394 two-byte, else they are encoded by one-byte. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5395 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5396 Return one of EOL_SEEN_XXX. */ |
| 17052 | 5397 |
|
19173
04ed7c3f5cee
(detect_eol_type): If EOL representation does not
Richard M. Stallman <rms@gnu.org>
parents:
19134
diff
changeset
|
5398 #define MAX_EOL_CHECK_COUNT 3 |
|
04ed7c3f5cee
(detect_eol_type): If EOL representation does not
Richard M. Stallman <rms@gnu.org>
parents:
19134
diff
changeset
|
5399 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5400 static int |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5401 detect_eol (source, src_bytes, category) |
|
84646
922a7e3b7383
(detect_eol_type, detect_eol_type_in_2_octet_form):
Micha?l Cadilhac <michael.cadilhac@lrde.org>
parents:
83648
diff
changeset
|
5402 const unsigned char *source; |
| 88365 | 5403 EMACS_INT src_bytes; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5404 enum coding_category category; |
| 17052 | 5405 { |
|
84646
922a7e3b7383
(detect_eol_type, detect_eol_type_in_2_octet_form):
Micha?l Cadilhac <michael.cadilhac@lrde.org>
parents:
83648
diff
changeset
|
5406 const unsigned char *src = source, *src_end = src + src_bytes; |
| 17052 | 5407 unsigned char c; |
| 88365 | 5408 int total = 0; |
| 5409 int eol_seen = EOL_SEEN_NONE; | |
| 5410 | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5411 if ((1 << category) & CATEGORY_MASK_UTF_16) |
| 88365 | 5412 { |
| 5413 int msb, lsb; | |
| 5414 | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5415 msb = category == (coding_category_utf_16_le |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5416 | coding_category_utf_16_le_nosig); |
| 88365 | 5417 lsb = 1 - msb; |
| 5418 | |
| 5419 while (src + 1 < src_end) | |
| 17052 | 5420 { |
| 88365 | 5421 c = src[lsb]; |
| 5422 if (src[msb] == 0 && (c == '\n' || c == '\r')) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5423 { |
| 88365 | 5424 int this_eol; |
| 5425 | |
| 5426 if (c == '\n') | |
| 5427 this_eol = EOL_SEEN_LF; | |
| 5428 else if (src + 3 >= src_end | |
| 5429 || src[msb + 2] != 0 | |
| 5430 || src[lsb + 2] != '\n') | |
| 5431 this_eol = EOL_SEEN_CR; | |
| 5432 else | |
| 89483 | 5433 this_eol = EOL_SEEN_CRLF; |
| 88365 | 5434 |
| 5435 if (eol_seen == EOL_SEEN_NONE) | |
| 5436 /* This is the first end-of-line. */ | |
| 5437 eol_seen = this_eol; | |
| 5438 else if (eol_seen != this_eol) | |
| 5439 { | |
| 5440 /* The found type is different from what found before. */ | |
| 5441 eol_seen = EOL_SEEN_LF; | |
| 5442 break; | |
| 5443 } | |
| 5444 if (++total == MAX_EOL_CHECK_COUNT) | |
| 5445 break; | |
| 5446 } | |
| 5447 src += 2; | |
| 5448 } | |
|
30833
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
5449 } |
| 88365 | 5450 else |
| 5451 { | |
| 5452 while (src < src_end) | |
| 5453 { | |
| 5454 c = *src++; | |
| 5455 if (c == '\n' || c == '\r') | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5456 { |
| 88365 | 5457 int this_eol; |
| 5458 | |
| 5459 if (c == '\n') | |
| 5460 this_eol = EOL_SEEN_LF; | |
| 5461 else if (src >= src_end || *src != '\n') | |
| 5462 this_eol = EOL_SEEN_CR; | |
| 5463 else | |
| 5464 this_eol = EOL_SEEN_CRLF, src++; | |
| 5465 | |
| 5466 if (eol_seen == EOL_SEEN_NONE) | |
| 5467 /* This is the first end-of-line. */ | |
| 5468 eol_seen = this_eol; | |
| 5469 else if (eol_seen != this_eol) | |
| 5470 { | |
| 5471 /* The found type is different from what found before. */ | |
| 5472 eol_seen = EOL_SEEN_LF; | |
| 5473 break; | |
| 5474 } | |
| 5475 if (++total == MAX_EOL_CHECK_COUNT) | |
| 5476 break; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5477 } |
| 17052 | 5478 } |
| 5479 } | |
| 88365 | 5480 return eol_seen; |
| 17052 | 5481 } |
| 5482 | |
| 88365 | 5483 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5484 static Lisp_Object |
| 88365 | 5485 adjust_coding_eol_type (coding, eol_seen) |
| 5486 struct coding_system *coding; | |
| 5487 int eol_seen; | |
| 5488 { | |
|
88430
6418a272b97e
* coding.c: Delete unused variables.
Kenichi Handa <handa@m17n.org>
parents:
88365
diff
changeset
|
5489 Lisp_Object eol_type; |
| 89483 | 5490 |
| 88365 | 5491 eol_type = CODING_ID_EOL_TYPE (coding->id); |
| 5492 if (eol_seen & EOL_SEEN_LF) | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5493 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5494 coding->id = CODING_SYSTEM_ID (AREF (eol_type, 0)); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5495 eol_type = Qunix; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5496 } |
|
88862
108e2535280d
(adjust_coding_eol_type): Fix eol_type/eol_seen mixup.
Dave Love <fx@gnu.org>
parents:
88856
diff
changeset
|
5497 else if (eol_seen & EOL_SEEN_CRLF) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5498 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5499 coding->id = CODING_SYSTEM_ID (AREF (eol_type, 1)); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5500 eol_type = Qdos; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5501 } |
|
88862
108e2535280d
(adjust_coding_eol_type): Fix eol_type/eol_seen mixup.
Dave Love <fx@gnu.org>
parents:
88856
diff
changeset
|
5502 else if (eol_seen & EOL_SEEN_CR) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5503 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5504 coding->id = CODING_SYSTEM_ID (AREF (eol_type, 2)); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5505 eol_type = Qmac; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5506 } |
|
19181
917138730635
(detect_eol_type): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
19173
diff
changeset
|
5507 return eol_type; |
| 17052 | 5508 } |
| 5509 | |
| 88365 | 5510 /* Detect how a text specified in CODING is encoded. If a coding |
| 5511 system is detected, update fields of CODING by the detected coding | |
| 5512 system. */ | |
| 17052 | 5513 |
| 5514 void | |
| 88365 | 5515 detect_coding (coding) |
| 17052 | 5516 struct coding_system *coding; |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5517 { |
| 89483 | 5518 const unsigned char *src, *src_end; |
| 88365 | 5519 |
| 5520 coding->consumed = coding->consumed_char = 0; | |
| 5521 coding->produced = coding->produced_char = 0; | |
| 5522 coding_set_source (coding); | |
| 5523 | |
| 5524 src_end = coding->source + coding->src_bytes; | |
| 5525 | |
| 5526 /* If we have not yet decided the text encoding type, detect it | |
| 5527 now. */ | |
| 5528 if (EQ (CODING_ATTR_TYPE (CODING_ID_ATTRS (coding->id)), Qundecided)) | |
| 5529 { | |
| 5530 int c, i; | |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5531 struct coding_detection_info detect_info; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5532 |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5533 detect_info.checked = detect_info.found = detect_info.rejected = 0; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5534 for (i = 0, src = coding->source; src < src_end; i++, src++) |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5535 { |
| 88365 | 5536 c = *src; |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5537 if (c & 0x80) |
| 88365 | 5538 break; |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5539 if (c < 0x20 |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5540 && (c == ISO_CODE_ESC || c == ISO_CODE_SI || c == ISO_CODE_SO) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5541 && ! inhibit_iso_escape_detection |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5542 && ! detect_info.checked) |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5543 { |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5544 coding->head_ascii = src - (coding->source + coding->consumed); |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5545 if (detect_coding_iso_2022 (coding, &detect_info)) |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5546 { |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5547 /* We have scanned the whole data. */ |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5548 if (! (detect_info.rejected & CATEGORY_MASK_ISO_7_ELSE)) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5549 /* We didn't find an 8-bit code. */ |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5550 src = src_end; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5551 break; |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5552 } |
|
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5553 } |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5554 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5555 coding->head_ascii = src - (coding->source + coding->consumed); |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5556 |
|
89976
0217b5bc6404
(detect_coding): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89974
diff
changeset
|
5557 if (coding->head_ascii < coding->src_bytes |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5558 || detect_info.found) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5559 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5560 enum coding_category category; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5561 struct coding_system *this; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5562 |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5563 if (coding->head_ascii == coding->src_bytes) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5564 /* As all bytes are 7-bit, we can ignore non-ISO-2022 codings. */ |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5565 for (i = 0; i < coding_category_raw_text; i++) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5566 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5567 category = coding_priorities[i]; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5568 this = coding_categories + category; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5569 if (detect_info.found & (1 << category)) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5570 break; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5571 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5572 else |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5573 for (i = 0; i < coding_category_raw_text; i++) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5574 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5575 category = coding_priorities[i]; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5576 this = coding_categories + category; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5577 if (this->id < 0) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5578 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5579 /* No coding system of this category is defined. */ |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5580 detect_info.rejected |= (1 << category); |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5581 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5582 else if (category >= coding_category_raw_text) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5583 continue; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5584 else if (detect_info.checked & (1 << category)) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5585 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5586 if (detect_info.found & (1 << category)) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5587 break; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5588 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5589 else if ((*(this->detector)) (coding, &detect_info) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5590 && detect_info.found & (1 << category)) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5591 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5592 if (category == coding_category_utf_16_auto) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5593 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5594 if (detect_info.found & CATEGORY_MASK_UTF_16_LE) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5595 category = coding_category_utf_16_le; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5596 else |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5597 category = coding_category_utf_16_be; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5598 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5599 break; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5600 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5601 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
5602 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5603 if (i < coding_category_raw_text) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5604 setup_coding_system (CODING_ID_NAME (this->id), coding); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5605 else if (detect_info.rejected == CATEGORY_MASK_ANY) |
| 88365 | 5606 setup_coding_system (Qraw_text, coding); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5607 else if (detect_info.rejected) |
| 88365 | 5608 for (i = 0; i < coding_category_raw_text; i++) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5609 if (! (detect_info.rejected & (1 << coding_priorities[i]))) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5610 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5611 this = coding_categories + coding_priorities[i]; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5612 setup_coding_system (CODING_ID_NAME (this->id), coding); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5613 break; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
5614 } |
| 88365 | 5615 } |
| 5616 } | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5617 else if (XINT (CODING_ATTR_CATEGORY (CODING_ID_ATTRS (coding->id))) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5618 == coding_category_utf_16_auto) |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5619 { |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5620 Lisp_Object coding_systems; |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5621 struct coding_detection_info detect_info; |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5622 |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5623 coding_systems |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5624 = AREF (CODING_ID_ATTRS (coding->id), coding_attr_utf_16_bom); |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5625 detect_info.found = detect_info.rejected = 0; |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5626 if (CONSP (coding_systems) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5627 && detect_coding_utf_16 (coding, &detect_info)) |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5628 { |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5629 if (detect_info.found & CATEGORY_MASK_UTF_16_LE) |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5630 setup_coding_system (XCAR (coding_systems), coding); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5631 else if (detect_info.found & CATEGORY_MASK_UTF_16_BE) |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5632 setup_coding_system (XCDR (coding_systems), coding); |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5633 } |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
5634 } |
| 88365 | 5635 } |
| 5636 | |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5637 |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5638 static void |
| 88365 | 5639 decode_eol (coding) |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5640 struct coding_system *coding; |
| 88365 | 5641 { |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5642 Lisp_Object eol_type; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5643 unsigned char *p, *pbeg, *pend; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5644 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5645 eol_type = CODING_ID_EOL_TYPE (coding->id); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5646 if (EQ (eol_type, Qunix)) |
| 17052 | 5647 return; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5648 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5649 if (NILP (coding->dst_object)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5650 pbeg = coding->destination; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5651 else |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5652 pbeg = BYTE_POS_ADDR (coding->dst_pos_byte); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5653 pend = pbeg + coding->produced; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5654 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5655 if (VECTORP (eol_type)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5656 { |
| 88365 | 5657 int eol_seen = EOL_SEEN_NONE; |
| 5658 | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5659 for (p = pbeg; p < pend; p++) |
| 88365 | 5660 { |
| 5661 if (*p == '\n') | |
| 5662 eol_seen |= EOL_SEEN_LF; | |
| 5663 else if (*p == '\r') | |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5664 { |
| 88365 | 5665 if (p + 1 < pend && *(p + 1) == '\n') |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5666 { |
| 88365 | 5667 eol_seen |= EOL_SEEN_CRLF; |
| 5668 p++; | |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5669 } |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5670 else |
| 88365 | 5671 eol_seen |= EOL_SEEN_CR; |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5672 } |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5673 } |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5674 if (eol_seen != EOL_SEEN_NONE |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5675 && eol_seen != EOL_SEEN_LF |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5676 && eol_seen != EOL_SEEN_CRLF |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5677 && eol_seen != EOL_SEEN_CR) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5678 eol_seen = EOL_SEEN_LF; |
| 88365 | 5679 if (eol_seen != EOL_SEEN_NONE) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5680 eol_type = adjust_coding_eol_type (coding, eol_seen); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5681 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5682 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5683 if (EQ (eol_type, Qmac)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5684 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5685 for (p = pbeg; p < pend; p++) |
| 88365 | 5686 if (*p == '\r') |
| 5687 *p = '\n'; | |
| 5688 } | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5689 else if (EQ (eol_type, Qdos)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5690 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5691 int n = 0; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5692 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5693 if (NILP (coding->dst_object)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5694 { |
|
90378
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5695 /* Start deleting '\r' from the tail to minimize the memory |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5696 movement. */ |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5697 for (p = pend - 2; p >= pbeg; p--) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5698 if (*p == '\r') |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5699 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5700 safe_bcopy ((char *) (p + 1), (char *) p, pend-- - p - 1); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5701 n++; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5702 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5703 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5704 else |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5705 { |
|
90378
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5706 int pos_byte = coding->dst_pos_byte; |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5707 int pos = coding->dst_pos; |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5708 int pos_end = pos + coding->produced_char - 1; |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5709 |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5710 while (pos < pos_end) |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5711 { |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5712 p = BYTE_POS_ADDR (pos_byte); |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5713 if (*p == '\r' && p[1] == '\n') |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5714 { |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5715 del_range_2 (pos, pos_byte, pos + 1, pos_byte + 1, 0); |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5716 n++; |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5717 pos_end--; |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5718 } |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5719 pos++; |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5720 pos_byte += BYTES_BY_CHAR_HEAD (*p); |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
5721 } |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5722 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5723 coding->produced -= n; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
5724 coding->produced_char -= n; |
| 17052 | 5725 } |
| 5726 } | |
| 5727 | |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5728 |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
5729 /* Return a translation table (or list of them) from coding system |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
5730 attribute vector ATTRS for encoding (ENCODEP is nonzero) or |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
5731 decoding (ENCODEP is zero). */ |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5732 |
|
89858
23cb9ed79225
(get_translation_table): Declare it as Lisp_Object.
Kenichi Handa <handa@m17n.org>
parents:
89856
diff
changeset
|
5733 static Lisp_Object |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5734 get_translation_table (attrs, encodep, max_lookup) |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5735 Lisp_Object attrs; |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5736 int encodep, *max_lookup; |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5737 { |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5738 Lisp_Object standard, translation_table; |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5739 Lisp_Object val; |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5740 |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5741 if (encodep) |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5742 translation_table = CODING_ATTR_ENCODE_TBL (attrs), |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5743 standard = Vstandard_translation_table_for_encode; |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5744 else |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5745 translation_table = CODING_ATTR_DECODE_TBL (attrs), |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5746 standard = Vstandard_translation_table_for_decode; |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
5747 if (NILP (translation_table)) |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5748 translation_table = standard; |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5749 else |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5750 { |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5751 if (SYMBOLP (translation_table)) |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5752 translation_table = Fget (translation_table, Qtranslation_table); |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5753 else if (CONSP (translation_table)) |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5754 { |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5755 translation_table = Fcopy_sequence (translation_table); |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5756 for (val = translation_table; CONSP (val); val = XCDR (val)) |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5757 if (SYMBOLP (XCAR (val))) |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5758 XSETCAR (val, Fget (XCAR (val), Qtranslation_table)); |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5759 } |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5760 if (CHAR_TABLE_P (standard)) |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5761 { |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5762 if (CONSP (translation_table)) |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5763 translation_table = nconc2 (translation_table, |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5764 Fcons (standard, Qnil)); |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5765 else |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5766 translation_table = Fcons (translation_table, |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5767 Fcons (standard, Qnil)); |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5768 } |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5769 } |
|
89861
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5770 |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5771 if (max_lookup) |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5772 { |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5773 *max_lookup = 1; |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5774 if (CHAR_TABLE_P (translation_table) |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5775 && CHAR_TABLE_EXTRA_SLOTS (XCHAR_TABLE (translation_table)) > 1) |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5776 { |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5777 val = XCHAR_TABLE (translation_table)->extras[1]; |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5778 if (NATNUMP (val) && *max_lookup < XFASTINT (val)) |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5779 *max_lookup = XFASTINT (val); |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5780 } |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5781 else if (CONSP (translation_table)) |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5782 { |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5783 Lisp_Object tail, val; |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5784 |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5785 for (tail = translation_table; CONSP (tail); tail = XCDR (tail)) |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5786 if (CHAR_TABLE_P (XCAR (tail)) |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5787 && CHAR_TABLE_EXTRA_SLOTS (XCHAR_TABLE (XCAR (tail))) > 1) |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5788 { |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5789 val = XCHAR_TABLE (XCAR (tail))->extras[1]; |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5790 if (NATNUMP (val) && *max_lookup < XFASTINT (val)) |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5791 *max_lookup = XFASTINT (val); |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5792 } |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
5793 } |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
5794 } |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5795 return translation_table; |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5796 } |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5797 |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5798 #define LOOKUP_TRANSLATION_TABLE(table, c, trans) \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5799 do { \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5800 trans = Qnil; \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5801 if (CHAR_TABLE_P (table)) \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5802 { \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5803 trans = CHAR_TABLE_REF (table, c); \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5804 if (CHARACTERP (trans)) \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5805 c = XFASTINT (trans), trans = Qnil; \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5806 } \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5807 else if (CONSP (table)) \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5808 { \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5809 Lisp_Object tail; \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5810 \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5811 for (tail = table; CONSP (tail); tail = XCDR (tail)) \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5812 if (CHAR_TABLE_P (XCAR (tail))) \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5813 { \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5814 trans = CHAR_TABLE_REF (XCAR (tail), c); \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5815 if (CHARACTERP (trans)) \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5816 c = XFASTINT (trans), trans = Qnil; \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5817 else if (! NILP (trans)) \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5818 break; \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5819 } \ |
|
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5820 } \ |
|
89858
23cb9ed79225
(get_translation_table): Declare it as Lisp_Object.
Kenichi Handa <handa@m17n.org>
parents:
89856
diff
changeset
|
5821 } while (0) |
|
23cb9ed79225
(get_translation_table): Declare it as Lisp_Object.
Kenichi Handa <handa@m17n.org>
parents:
89856
diff
changeset
|
5822 |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
5823 |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5824 static Lisp_Object |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5825 get_translation (val, buf, buf_end, last_block, from_nchars, to_nchars) |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5826 Lisp_Object val; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5827 int *buf, *buf_end; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5828 int last_block; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5829 int *from_nchars, *to_nchars; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5830 { |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5831 /* VAL is TO or (([FROM-CHAR ...] . TO) ...) where TO is TO-CHAR or |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5832 [TO-CHAR ...]. */ |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5833 if (CONSP (val)) |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5834 { |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5835 Lisp_Object from, tail; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5836 int i, len; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5837 |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5838 for (tail = val; CONSP (tail); tail = XCDR (tail)) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5839 { |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5840 val = XCAR (tail); |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5841 from = XCAR (val); |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5842 len = ASIZE (from); |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5843 for (i = 0; i < len; i++) |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5844 { |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5845 if (buf + i == buf_end) |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5846 { |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5847 if (! last_block) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5848 return Qt; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5849 break; |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5850 } |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5851 if (XINT (AREF (from, i)) != buf[i]) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5852 break; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5853 } |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5854 if (i == len) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5855 { |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5856 val = XCDR (val); |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5857 *from_nchars = len; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5858 break; |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5859 } |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5860 } |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5861 if (! CONSP (tail)) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5862 return Qnil; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5863 } |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5864 if (VECTORP (val)) |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5865 *buf = XINT (AREF (val, 0)), *to_nchars = ASIZE (val); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5866 else |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5867 *buf = XINT (val); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5868 return val; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5869 } |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5870 |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5871 |
| 88365 | 5872 static int |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5873 produce_chars (coding, translation_table, last_block) |
| 17052 | 5874 struct coding_system *coding; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5875 Lisp_Object translation_table; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5876 int last_block; |
| 17052 | 5877 { |
| 88365 | 5878 unsigned char *dst = coding->destination + coding->produced; |
| 5879 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 5880 int produced; | |
| 5881 int produced_chars = 0; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5882 int carryover = 0; |
| 88365 | 5883 |
| 5884 if (! coding->chars_at_source) | |
| 5885 { | |
| 5886 /* Characters are in coding->charbuf. */ | |
|
89575
59d10ebd2a0b
(produce_chars): Revert last change.
Andreas Schwab <schwab@suse.de>
parents:
89571
diff
changeset
|
5887 int *buf = coding->charbuf; |
|
59d10ebd2a0b
(produce_chars): Revert last change.
Andreas Schwab <schwab@suse.de>
parents:
89571
diff
changeset
|
5888 int *buf_end = buf + coding->charbuf_used; |
| 88365 | 5889 |
| 5890 if (BUFFERP (coding->src_object) | |
| 5891 && EQ (coding->src_object, coding->dst_object)) | |
| 89483 | 5892 dst_end = ((unsigned char *) coding->source) + coding->consumed; |
| 88365 | 5893 |
| 5894 while (buf < buf_end) | |
| 5895 { | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5896 int c = *buf, i; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5897 |
| 88365 | 5898 if (c >= 0) |
| 5899 { | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5900 int from_nchars = 1, to_nchars = 1; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5901 Lisp_Object trans = Qnil; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5902 |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
5903 LOOKUP_TRANSLATION_TABLE (translation_table, c, trans); |
|
89858
23cb9ed79225
(get_translation_table): Declare it as Lisp_Object.
Kenichi Handa <handa@m17n.org>
parents:
89856
diff
changeset
|
5904 if (! NILP (trans)) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5905 { |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5906 trans = get_translation (trans, buf, buf_end, last_block, |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5907 &from_nchars, &to_nchars); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5908 if (EQ (trans, Qt)) |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5909 break; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5910 c = *buf; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5911 } |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5912 |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5913 if (dst + MAX_MULTIBYTE_LENGTH * to_nchars > dst_end) |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5914 { |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5915 dst = alloc_destination (coding, |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5916 buf_end - buf |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5917 + MAX_MULTIBYTE_LENGTH * to_nchars, |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5918 dst); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5919 dst_end = coding->destination + coding->dst_bytes; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5920 } |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5921 |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5922 for (i = 0; i < to_nchars; i++) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5923 { |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5924 if (i > 0) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
5925 c = XINT (AREF (trans, i)); |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5926 if (coding->dst_multibyte |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5927 || ! CHAR_BYTE8_P (c)) |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5928 CHAR_STRING_ADVANCE (c, dst); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5929 else |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5930 *dst++ = CHAR_TO_BYTE8 (c); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5931 } |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5932 produced_chars += to_nchars; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5933 *buf++ = to_nchars; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5934 while (--from_nchars > 0) |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5935 *buf++ = 0; |
| 88365 | 5936 } |
| 5937 else | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5938 /* This is an annotation datum. (-C) is the length. */ |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5939 buf += -c; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5940 } |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
5941 carryover = buf_end - buf; |
|
30833
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
5942 } |
|
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
5943 else |
|
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
5944 { |
| 89483 | 5945 const unsigned char *src = coding->source; |
| 5946 const unsigned char *src_end = src + coding->src_bytes; | |
| 88365 | 5947 Lisp_Object eol_type; |
| 5948 | |
| 5949 eol_type = CODING_ID_EOL_TYPE (coding->id); | |
| 5950 | |
| 5951 if (coding->src_multibyte != coding->dst_multibyte) | |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5952 { |
| 88365 | 5953 if (coding->src_multibyte) |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5954 { |
|
88443
6b86cf30a0b9
(produce_chars): Set the variable `multibytep' correctly.
Kenichi Handa <handa@m17n.org>
parents:
88438
diff
changeset
|
5955 int multibytep = 1; |
| 88365 | 5956 int consumed_chars; |
| 5957 | |
| 5958 while (1) | |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5959 { |
| 89483 | 5960 const unsigned char *src_base = src; |
| 88365 | 5961 int c; |
| 5962 | |
| 5963 ONE_MORE_BYTE (c); | |
| 5964 if (c == '\r') | |
| 5965 { | |
| 5966 if (EQ (eol_type, Qdos)) | |
| 5967 { | |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5968 if (src == src_end) |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5969 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
5970 record_conversion_result |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
5971 (coding, CODING_RESULT_INSUFFICIENT_SRC); |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5972 goto no_more_source; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5973 } |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5974 if (*src == '\n') |
| 88365 | 5975 c = *src++; |
| 5976 } | |
| 5977 else if (EQ (eol_type, Qmac)) | |
| 5978 c = '\n'; | |
| 5979 } | |
| 5980 if (dst == dst_end) | |
| 5981 { | |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5982 coding->consumed = src - coding->source; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5983 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5984 if (EQ (coding->src_object, coding->dst_object)) |
| 89483 | 5985 dst_end = (unsigned char *) src; |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5986 if (dst == dst_end) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5987 { |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5988 dst = alloc_destination (coding, src_end - src + 1, |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5989 dst); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5990 dst_end = coding->destination + coding->dst_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5991 coding_set_source (coding); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5992 src = coding->source + coding->consumed; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5993 src_end = coding->source + coding->src_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5994 } |
| 88365 | 5995 } |
| 5996 *dst++ = c; | |
| 5997 produced_chars++; | |
| 5998 } | |
| 5999 no_more_source: | |
| 6000 ; | |
| 6001 } | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6002 else |
| 88365 | 6003 while (src < src_end) |
| 6004 { | |
|
88443
6b86cf30a0b9
(produce_chars): Set the variable `multibytep' correctly.
Kenichi Handa <handa@m17n.org>
parents:
88438
diff
changeset
|
6005 int multibytep = 1; |
| 88365 | 6006 int c = *src++; |
| 6007 | |
| 6008 if (c == '\r') | |
| 6009 { | |
| 6010 if (EQ (eol_type, Qdos)) | |
| 6011 { | |
| 6012 if (src < src_end | |
| 6013 && *src == '\n') | |
| 6014 c = *src++; | |
| 6015 } | |
| 6016 else if (EQ (eol_type, Qmac)) | |
| 6017 c = '\n'; | |
| 6018 } | |
| 6019 if (dst >= dst_end - 1) | |
| 6020 { | |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6021 coding->consumed = src - coding->source; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6022 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6023 if (EQ (coding->src_object, coding->dst_object)) |
| 89483 | 6024 dst_end = (unsigned char *) src; |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6025 if (dst >= dst_end - 1) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6026 { |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6027 dst = alloc_destination (coding, src_end - src + 2, |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6028 dst); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6029 dst_end = coding->destination + coding->dst_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6030 coding_set_source (coding); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6031 src = coding->source + coding->consumed; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6032 src_end = coding->source + coding->src_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6033 } |
| 88365 | 6034 } |
| 6035 EMIT_ONE_BYTE (c); | |
| 6036 } | |
| 6037 } | |
| 6038 else | |
| 6039 { | |
| 6040 if (!EQ (coding->src_object, coding->dst_object)) | |
| 6041 { | |
| 6042 int require = coding->src_bytes - coding->dst_bytes; | |
| 6043 | |
| 6044 if (require > 0) | |
|
23325
bbd06336cd0c
(check_composing_code): If the current composing
Kenichi Handa <handa@m17n.org>
parents:
23315
diff
changeset
|
6045 { |
| 88365 | 6046 EMACS_INT offset = src - coding->source; |
| 6047 | |
| 6048 dst = alloc_destination (coding, require, dst); | |
| 6049 coding_set_source (coding); | |
| 6050 src = coding->source + offset; | |
| 6051 src_end = coding->source + coding->src_bytes; | |
|
23325
bbd06336cd0c
(check_composing_code): If the current composing
Kenichi Handa <handa@m17n.org>
parents:
23315
diff
changeset
|
6052 } |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
6053 } |
| 88365 | 6054 produced_chars = coding->src_chars; |
| 6055 while (src < src_end) | |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
6056 { |
| 88365 | 6057 int c = *src++; |
| 6058 | |
| 6059 if (c == '\r') | |
|
23325
bbd06336cd0c
(check_composing_code): If the current composing
Kenichi Handa <handa@m17n.org>
parents:
23315
diff
changeset
|
6060 { |
| 88365 | 6061 if (EQ (eol_type, Qdos)) |
| 6062 { | |
| 6063 if (src < src_end | |
| 6064 && *src == '\n') | |
| 6065 c = *src++; | |
| 6066 produced_chars--; | |
| 6067 } | |
| 6068 else if (EQ (eol_type, Qmac)) | |
| 6069 c = '\n'; | |
|
23325
bbd06336cd0c
(check_composing_code): If the current composing
Kenichi Handa <handa@m17n.org>
parents:
23315
diff
changeset
|
6070 } |
| 88365 | 6071 *dst++ = c; |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
6072 } |
|
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
6073 } |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6074 coding->consumed = coding->src_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
6075 coding->consumed_char = coding->src_chars; |
| 88365 | 6076 } |
| 6077 | |
| 6078 produced = dst - (coding->destination + coding->produced); | |
|
90809
3c52757d5f6e
(produce_chars): Don't call insert_from_gap if no
Kenichi Handa <handa@m17n.org>
parents:
90772
diff
changeset
|
6079 if (BUFFERP (coding->dst_object) && produced_chars > 0) |
| 88365 | 6080 insert_from_gap (produced_chars, produced); |
| 6081 coding->produced += produced; | |
| 6082 coding->produced_char += produced_chars; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6083 return carryover; |
| 88365 | 6084 } |
| 6085 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6086 /* Compose text in CODING->object according to the annotation data at |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6087 CHARBUF. CHARBUF is an array: |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6088 [ -LENGTH ANNOTATION_MASK FROM TO METHOD COMP_LEN [ COMPONENTS... ] ] |
| 88365 | 6089 */ |
| 6090 | |
| 6091 static INLINE void | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6092 produce_composition (coding, charbuf, pos) |
| 88365 | 6093 struct coding_system *coding; |
| 6094 int *charbuf; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6095 EMACS_INT pos; |
| 88365 | 6096 { |
| 6097 int len; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6098 EMACS_INT to; |
| 88365 | 6099 enum composition_method method; |
| 6100 Lisp_Object components; | |
| 6101 | |
| 6102 len = -charbuf[0]; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6103 to = pos + charbuf[2]; |
| 89892 | 6104 if (to <= pos) |
| 6105 return; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6106 method = (enum composition_method) (charbuf[3]); |
| 88365 | 6107 |
| 6108 if (method == COMPOSITION_RELATIVE) | |
| 6109 components = Qnil; | |
| 89892 | 6110 else if (method >= COMPOSITION_WITH_RULE |
| 6111 && method <= COMPOSITION_WITH_RULE_ALTCHARS) | |
| 88365 | 6112 { |
| 6113 Lisp_Object args[MAX_COMPOSITION_COMPONENTS * 2 - 1]; | |
| 6114 int i; | |
| 6115 | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6116 len -= 4; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6117 charbuf += 4; |
| 88365 | 6118 for (i = 0; i < len; i++) |
| 89892 | 6119 { |
| 6120 args[i] = make_number (charbuf[i]); | |
|
90359
041f75914d0c
(produce_composition): Compare charbuf[i] instead of
Kenichi Handa <handa@m17n.org>
parents:
90354
diff
changeset
|
6121 if (charbuf[i] < 0) |
| 89892 | 6122 return; |
| 6123 } | |
| 88365 | 6124 components = (method == COMPOSITION_WITH_ALTCHARS |
| 6125 ? Fstring (len, args) : Fvector (len, args)); | |
|
30833
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
6126 } |
|
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
6127 else |
| 89892 | 6128 return; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6129 compose_text (pos, to, components, Qnil, coding->dst_object); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6130 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6131 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6132 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6133 /* Put `charset' property on text in CODING->object according to |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6134 the annotation data at CHARBUF. CHARBUF is an array: |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6135 [ -LENGTH ANNOTATION_MASK NCHARS CHARSET-ID ] |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6136 */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6137 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6138 static INLINE void |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6139 produce_charset (coding, charbuf, pos) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6140 struct coding_system *coding; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6141 int *charbuf; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6142 EMACS_INT pos; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6143 { |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6144 EMACS_INT from = pos - charbuf[2]; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6145 struct charset *charset = CHARSET_FROM_ID (charbuf[3]); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6146 |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6147 Fput_text_property (make_number (from), make_number (pos), |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6148 Qcharset, CHARSET_NAME (charset), |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6149 coding->dst_object); |
| 88365 | 6150 } |
| 6151 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6152 |
| 88365 | 6153 #define CHARBUF_SIZE 0x4000 |
| 6154 | |
| 6155 #define ALLOC_CONVERSION_WORK_AREA(coding) \ | |
| 6156 do { \ | |
| 6157 int size = CHARBUF_SIZE;; \ | |
| 6158 \ | |
| 6159 coding->charbuf = NULL; \ | |
| 6160 while (size > 1024) \ | |
| 6161 { \ | |
| 6162 coding->charbuf = (int *) alloca (sizeof (int) * size); \ | |
| 6163 if (coding->charbuf) \ | |
| 6164 break; \ | |
| 6165 size >>= 1; \ | |
| 6166 } \ | |
| 6167 if (! coding->charbuf) \ | |
| 6168 { \ | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6169 record_conversion_result (coding, CODING_RESULT_INSUFFICIENT_MEM); \ |
| 88365 | 6170 return coding->result; \ |
| 6171 } \ | |
| 6172 coding->charbuf_size = size; \ | |
| 6173 } while (0) | |
| 6174 | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6175 |
|
30833
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
6176 static void |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6177 produce_annotation (coding, pos) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6178 struct coding_system *coding; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6179 EMACS_INT pos; |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
6180 { |
| 88365 | 6181 int *charbuf = coding->charbuf; |
| 6182 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 6183 | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6184 if (NILP (coding->dst_object)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6185 return; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6186 |
| 88365 | 6187 while (charbuf < charbuf_end) |
| 6188 { | |
| 6189 if (*charbuf >= 0) | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6190 pos += *charbuf++; |
| 88365 | 6191 else |
|
29877
7b43e1fb478a
(decode_eol_post_ccl): Special handling for undecided
Eli Zaretskii <eliz@gnu.org>
parents:
29725
diff
changeset
|
6192 { |
| 88365 | 6193 int len = -*charbuf; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6194 switch (charbuf[1]) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6195 { |
| 88365 | 6196 case CODING_ANNOTATE_COMPOSITION_MASK: |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6197 produce_composition (coding, charbuf, pos); |
| 88365 | 6198 break; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6199 case CODING_ANNOTATE_CHARSET_MASK: |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6200 produce_charset (coding, charbuf, pos); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6201 break; |
| 88365 | 6202 default: |
| 6203 abort (); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6204 } |
| 88365 | 6205 charbuf += len; |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
6206 } |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
6207 } |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
6208 } |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
6209 |
| 88365 | 6210 /* Decode the data at CODING->src_object into CODING->dst_object. |
| 6211 CODING->src_object is a buffer, a string, or nil. | |
| 6212 CODING->dst_object is a buffer. | |
| 6213 | |
| 6214 If CODING->src_object is a buffer, it must be the current buffer. | |
| 6215 In this case, if CODING->src_pos is positive, it is a position of | |
| 6216 the source text in the buffer, otherwise, the source text is in the | |
| 6217 gap area of the buffer, and CODING->src_pos specifies the offset of | |
| 6218 the text from GPT (which must be the same as PT). If this is the | |
| 6219 same buffer as CODING->dst_object, CODING->src_pos must be | |
| 6220 negative. | |
| 6221 | |
|
90380
4bf7966e0788
(decode_coding): Typo in comment fixed.
Kenichi Handa <handa@m17n.org>
parents:
90378
diff
changeset
|
6222 If CODING->src_object is a string, CODING->src_pos is an index to |
| 88365 | 6223 that string. |
| 6224 | |
| 6225 If CODING->src_object is nil, CODING->source must already point to | |
| 6226 the non-relocatable memory area. In this case, CODING->src_pos is | |
| 6227 an offset from CODING->source. | |
| 6228 | |
| 6229 The decoded data is inserted at the current point of the buffer | |
| 6230 CODING->dst_object. | |
| 6231 */ | |
| 6232 | |
| 6233 static int | |
| 6234 decode_coding (coding) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6235 struct coding_system *coding; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6236 { |
| 88365 | 6237 Lisp_Object attrs; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6238 Lisp_Object undo_list; |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
6239 Lisp_Object translation_table; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6240 int carryover; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6241 int i; |
| 88365 | 6242 |
| 6243 if (BUFFERP (coding->src_object) | |
| 6244 && coding->src_pos > 0 | |
| 6245 && coding->src_pos < GPT | |
| 6246 && coding->src_pos + coding->src_chars > GPT) | |
| 6247 move_gap_both (coding->src_pos, coding->src_pos_byte); | |
| 6248 | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6249 undo_list = Qt; |
| 88365 | 6250 if (BUFFERP (coding->dst_object)) |
| 6251 { | |
| 6252 if (current_buffer != XBUFFER (coding->dst_object)) | |
| 6253 set_buffer_internal (XBUFFER (coding->dst_object)); | |
| 6254 if (GPT != PT) | |
| 6255 move_gap_both (PT, PT_BYTE); | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6256 undo_list = current_buffer->undo_list; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6257 current_buffer->undo_list = Qt; |
| 88365 | 6258 } |
| 6259 | |
| 6260 coding->consumed = coding->consumed_char = 0; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
6261 coding->produced = coding->produced_char = 0; |
| 88365 | 6262 coding->chars_at_source = 0; |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6263 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
6264 coding->errors = 0; |
| 88365 | 6265 |
| 6266 ALLOC_CONVERSION_WORK_AREA (coding); | |
| 6267 | |
| 6268 attrs = CODING_ID_ATTRS (coding->id); | |
|
89861
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
6269 translation_table = get_translation_table (attrs, 0, NULL); |
| 88365 | 6270 |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6271 carryover = 0; |
| 88365 | 6272 do |
| 6273 { | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6274 EMACS_INT pos = coding->dst_pos + coding->produced_char; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6275 |
| 88365 | 6276 coding_set_source (coding); |
| 6277 coding->annotated = 0; | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6278 coding->charbuf_used = carryover; |
| 88365 | 6279 (*(coding->decoder)) (coding); |
| 6280 coding_set_destination (coding); | |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6281 carryover = produce_chars (coding, translation_table, 0); |
| 88365 | 6282 if (coding->annotated) |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6283 produce_annotation (coding, pos); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6284 for (i = 0; i < carryover; i++) |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6285 coding->charbuf[i] |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6286 = coding->charbuf[coding->charbuf_used - carryover + i]; |
| 88365 | 6287 } |
| 6288 while (coding->consumed < coding->src_bytes | |
|
90336
f0338dbf2276
(decode_coding): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
90327
diff
changeset
|
6289 && (coding->result == CODING_RESULT_SUCCESS |
|
f0338dbf2276
(decode_coding): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
90327
diff
changeset
|
6290 || coding->result == CODING_RESULT_INVALID_SRC)); |
| 88365 | 6291 |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6292 if (carryover > 0) |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6293 { |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6294 coding_set_destination (coding); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6295 coding->charbuf_used = carryover; |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6296 produce_chars (coding, translation_table, 1); |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6297 } |
|
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6298 |
| 88365 | 6299 coding->carryover_bytes = 0; |
| 6300 if (coding->consumed < coding->src_bytes) | |
| 6301 { | |
| 6302 int nbytes = coding->src_bytes - coding->consumed; | |
| 89483 | 6303 const unsigned char *src; |
| 88365 | 6304 |
| 6305 coding_set_source (coding); | |
| 6306 coding_set_destination (coding); | |
| 6307 src = coding->source + coding->consumed; | |
| 6308 | |
| 6309 if (coding->mode & CODING_MODE_LAST_BLOCK) | |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
6310 { |
| 88365 | 6311 /* Flush out unprocessed data as binary chars. We are sure |
| 6312 that the number of data is less than the size of | |
| 6313 coding->charbuf. */ | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6314 coding->charbuf_used = 0; |
| 88365 | 6315 while (nbytes-- > 0) |
| 6316 { | |
| 6317 int c = *src++; | |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
6318 |
|
90243
c59afb15f5c6
(decode_coding): Fix handling of invalid bytes.
Kenichi Handa <handa@m17n.org>
parents:
90231
diff
changeset
|
6319 if (c & 0x80) |
|
c59afb15f5c6
(decode_coding): Fix handling of invalid bytes.
Kenichi Handa <handa@m17n.org>
parents:
90231
diff
changeset
|
6320 c = BYTE8_TO_CHAR (c); |
|
c59afb15f5c6
(decode_coding): Fix handling of invalid bytes.
Kenichi Handa <handa@m17n.org>
parents:
90231
diff
changeset
|
6321 coding->charbuf[coding->charbuf_used++] = c; |
| 88365 | 6322 } |
|
89863
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
6323 produce_chars (coding, Qnil, 1); |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
6324 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6325 else |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6326 { |
| 88365 | 6327 /* Record unprocessed bytes in coding->carryover. We are |
| 6328 sure that the number of data is less than the size of | |
| 6329 coding->carryover. */ | |
| 6330 unsigned char *p = coding->carryover; | |
| 6331 | |
| 6332 coding->carryover_bytes = nbytes; | |
| 6333 while (nbytes-- > 0) | |
| 6334 *p++ = *src++; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6335 } |
| 88365 | 6336 coding->consumed = coding->src_bytes; |
| 6337 } | |
| 6338 | |
|
90378
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
6339 if (! EQ (CODING_ID_EOL_TYPE (coding->id), Qunix)) |
|
0aec08f4c729
(decode_eol): Pay attention to buffer relocation in
Kenichi Handa <handa@m17n.org>
parents:
90363
diff
changeset
|
6340 decode_eol (coding); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6341 if (BUFFERP (coding->dst_object)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6342 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6343 current_buffer->undo_list = undo_list; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6344 record_insert (coding->dst_pos, coding->produced_char); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6345 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
6346 return coding->result; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6347 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6348 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6349 |
|
89394
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
6350 /* Extract an annotation datum from a composition starting at POS and |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6351 ending before LIMIT of CODING->src_object (buffer or string), store |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6352 the data in BUF, set *STOP to a starting position of the next |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6353 composition (if any) or to LIMIT, and return the address of the |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6354 next element of BUF. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6355 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6356 If such an annotation is not found, set *STOP to a starting |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6357 position of a composition after POS (if any) or to LIMIT, and |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6358 return BUF. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6359 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6360 static INLINE int * |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6361 handle_composition_annotation (pos, limit, coding, buf, stop) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6362 EMACS_INT pos, limit; |
| 26847 | 6363 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6364 int *buf; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6365 EMACS_INT *stop; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6366 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6367 EMACS_INT start, end; |
| 26847 | 6368 Lisp_Object prop; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6369 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6370 if (! find_composition (pos, limit, &start, &end, &prop, coding->src_object) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6371 || end > limit) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6372 *stop = limit; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6373 else if (start > pos) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6374 *stop = start; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6375 else |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6376 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6377 if (start == pos) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6378 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6379 /* We found a composition. Store the corresponding |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6380 annotation data in BUF. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6381 int *head = buf; |
| 26847 | 6382 enum composition_method method = COMPOSITION_METHOD (prop); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6383 int nchars = COMPOSITION_LENGTH (prop); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6384 |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6385 ADD_COMPOSITION_DATA (buf, nchars, method); |
| 26847 | 6386 if (method != COMPOSITION_RELATIVE) |
| 6387 { | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6388 Lisp_Object components; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6389 int len, i, i_byte; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6390 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6391 components = COMPOSITION_COMPONENTS (prop); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6392 if (VECTORP (components)) |
| 26847 | 6393 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6394 len = XVECTOR (components)->size; |
| 26847 | 6395 for (i = 0; i < len; i++) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6396 *buf++ = XINT (AREF (components, i)); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6397 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6398 else if (STRINGP (components)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6399 { |
| 89483 | 6400 len = SCHARS (components); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6401 i = i_byte = 0; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6402 while (i < len) |
| 26847 | 6403 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6404 FETCH_STRING_CHAR_ADVANCE (*buf, components, i, i_byte); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6405 buf++; |
| 26847 | 6406 } |
| 6407 } | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6408 else if (INTEGERP (components)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6409 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6410 len = 1; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6411 *buf++ = XINT (components); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6412 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6413 else if (CONSP (components)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6414 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6415 for (len = 0; CONSP (components); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6416 len++, components = XCDR (components)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6417 *buf++ = XINT (XCAR (components)); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6418 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6419 else |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6420 abort (); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6421 *head -= len; |
| 26847 | 6422 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6423 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6424 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6425 if (find_composition (end, limit, &start, &end, &prop, |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6426 coding->src_object) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6427 && end <= limit) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6428 *stop = start; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6429 else |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6430 *stop = limit; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6431 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6432 return buf; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6433 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6434 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6435 |
|
89394
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
6436 /* Extract an annotation datum from a text property `charset' at POS of |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6437 CODING->src_object (buffer of string), store the data in BUF, set |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6438 *STOP to the position where the value of `charset' property changes |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6439 (limiting by LIMIT), and return the address of the next element of |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6440 BUF. |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6441 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6442 If the property value is nil, set *STOP to the position where the |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6443 property value is non-nil (limiting by LIMIT), and return BUF. */ |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6444 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6445 static INLINE int * |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6446 handle_charset_annotation (pos, limit, coding, buf, stop) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6447 EMACS_INT pos, limit; |
| 26847 | 6448 struct coding_system *coding; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6449 int *buf; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6450 EMACS_INT *stop; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6451 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6452 Lisp_Object val, next; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6453 int id; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6454 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6455 val = Fget_text_property (make_number (pos), Qcharset, coding->src_object); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6456 if (! NILP (val) && CHARSETP (val)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6457 id = XINT (CHARSET_SYMBOL_ID (val)); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6458 else |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6459 id = -1; |
|
89852
b636ae1109c6
(MAX_ANNOTATION_LENGTH): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
89851
diff
changeset
|
6460 ADD_CHARSET_DATA (buf, 0, id); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6461 next = Fnext_single_property_change (make_number (pos), Qcharset, |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6462 coding->src_object, |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6463 make_number (limit)); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6464 *stop = XINT (next); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6465 return buf; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6466 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6467 |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6468 |
| 88365 | 6469 static void |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
6470 consume_chars (coding, translation_table, max_lookup) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6471 struct coding_system *coding; |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6472 Lisp_Object translation_table; |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
6473 int max_lookup; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6474 { |
| 88365 | 6475 int *buf = coding->charbuf; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6476 int *buf_end = coding->charbuf + coding->charbuf_size; |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
6477 const unsigned char *src = coding->source + coding->consumed; |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6478 const unsigned char *src_end = coding->source + coding->src_bytes; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6479 EMACS_INT pos = coding->src_pos + coding->consumed_char; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6480 EMACS_INT end_pos = coding->src_pos + coding->src_chars; |
| 88365 | 6481 int multibytep = coding->src_multibyte; |
| 6482 Lisp_Object eol_type; | |
| 6483 int c; | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6484 EMACS_INT stop, stop_composition, stop_charset; |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
6485 int *lookup_buf = NULL; |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6486 |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6487 if (! NILP (translation_table)) |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
6488 lookup_buf = alloca (sizeof (int) * max_lookup); |
| 88365 | 6489 |
| 6490 eol_type = CODING_ID_EOL_TYPE (coding->id); | |
| 6491 if (VECTORP (eol_type)) | |
| 6492 eol_type = Qunix; | |
| 6493 | |
| 6494 /* Note: composition handling is not yet implemented. */ | |
| 6495 coding->common_flags &= ~CODING_ANNOTATE_COMPOSITION_MASK; | |
| 6496 | |
|
89562
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6497 if (NILP (coding->src_object)) |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6498 stop = stop_composition = stop_charset = end_pos; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6499 else |
|
89562
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6500 { |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6501 if (coding->common_flags & CODING_ANNOTATE_COMPOSITION_MASK) |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6502 stop = stop_composition = pos; |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6503 else |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6504 stop = stop_composition = end_pos; |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6505 if (coding->common_flags & CODING_ANNOTATE_CHARSET_MASK) |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6506 stop = stop_charset = pos; |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6507 else |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6508 stop_charset = end_pos; |
|
12fbcfebb9ad
(consume_chars): If coding->src_object is nil, don't check annotation.
Kenichi Handa <handa@m17n.org>
parents:
89545
diff
changeset
|
6509 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6510 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6511 /* Compensate for CRLF and conversion. */ |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6512 buf_end -= 1 + MAX_ANNOTATION_LENGTH; |
| 88365 | 6513 while (buf < buf_end) |
| 6514 { | |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6515 Lisp_Object trans; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6516 |
| 88365 | 6517 if (pos == stop) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6518 { |
| 88365 | 6519 if (pos == end_pos) |
| 6520 break; | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6521 if (pos == stop_composition) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6522 buf = handle_composition_annotation (pos, end_pos, coding, |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6523 buf, &stop_composition); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6524 if (pos == stop_charset) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6525 buf = handle_charset_annotation (pos, end_pos, coding, |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6526 buf, &stop_charset); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6527 stop = (stop_composition < stop_charset |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
6528 ? stop_composition : stop_charset); |
| 88365 | 6529 } |
| 6530 | |
| 6531 if (! multibytep) | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6532 { |
|
89462
4e359ebf3984
(decode_coding_iso_2022): Fix handling of invalid
Kenichi Handa <handa@m17n.org>
parents:
89448
diff
changeset
|
6533 EMACS_INT bytes; |
|
4e359ebf3984
(decode_coding_iso_2022): Fix handling of invalid
Kenichi Handa <handa@m17n.org>
parents:
89448
diff
changeset
|
6534 |
|
89933
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
6535 if (coding->encoder == encode_coding_raw_text) |
|
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
6536 c = *src++, pos++; |
|
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
6537 else if ((bytes = MULTIBYTE_LENGTH (src, src_end)) > 0) |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6538 c = STRING_CHAR_ADVANCE (src), pos += bytes; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6539 else |
|
89917
1763eef5ad02
(encode_coding_utf_8): Fix handling of raw-byte char.
Kenichi Handa <handa@m17n.org>
parents:
89905
diff
changeset
|
6540 c = BYTE8_TO_CHAR (*src), src++, pos++; |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6541 } |
| 88365 | 6542 else |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6543 c = STRING_CHAR_ADVANCE (src), pos++; |
| 88365 | 6544 if ((c == '\r') && (coding->mode & CODING_MODE_SELECTIVE_DISPLAY)) |
| 6545 c = '\n'; | |
| 6546 if (! EQ (eol_type, Qunix)) | |
| 6547 { | |
| 6548 if (c == '\n') | |
|
32443
57fa108c491f
(code_convert_region): Be sure to initialize coding->category_idx.
Kenichi Handa <handa@m17n.org>
parents:
31458
diff
changeset
|
6549 { |
| 88365 | 6550 if (EQ (eol_type, Qdos)) |
| 6551 *buf++ = '\r'; | |
| 6552 else | |
| 6553 c = '\r'; | |
|
32443
57fa108c491f
(code_convert_region): Be sure to initialize coding->category_idx.
Kenichi Handa <handa@m17n.org>
parents:
31458
diff
changeset
|
6554 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6555 } |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6556 |
|
89858
23cb9ed79225
(get_translation_table): Declare it as Lisp_Object.
Kenichi Handa <handa@m17n.org>
parents:
89856
diff
changeset
|
6557 trans = Qnil; |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
6558 LOOKUP_TRANSLATION_TABLE (translation_table, c, trans); |
|
89858
23cb9ed79225
(get_translation_table): Declare it as Lisp_Object.
Kenichi Handa <handa@m17n.org>
parents:
89856
diff
changeset
|
6559 if (NILP (trans)) |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6560 *buf++ = c; |
| 26847 | 6561 else |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6562 { |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6563 int from_nchars = 1, to_nchars = 1; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6564 int *lookup_buf_end; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6565 const unsigned char *p = src; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6566 int i; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6567 |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6568 lookup_buf[0] = c; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6569 for (i = 1; i < max_lookup && p < src_end; i++) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6570 lookup_buf[i] = STRING_CHAR_ADVANCE (p); |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6571 lookup_buf_end = lookup_buf + i; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6572 trans = get_translation (trans, lookup_buf, lookup_buf_end, 1, |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6573 &from_nchars, &to_nchars); |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6574 if (EQ (trans, Qt) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6575 || buf + to_nchars > buf_end) |
|
23881
20d595402dea
(DECODE_DESIGNATION): Jump to label_invalid_code if
Kenichi Handa <handa@m17n.org>
parents:
23564
diff
changeset
|
6576 break; |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6577 *buf++ = *lookup_buf; |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6578 for (i = 1; i < to_nchars; i++) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6579 *buf++ = XINT (AREF (trans, i)); |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6580 for (i = 1; i < from_nchars; i++, pos++) |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6581 src += MULTIBYTE_LENGTH_NO_CHECK (src); |
|
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
6582 } |
| 88365 | 6583 } |
| 6584 | |
| 6585 coding->consumed = src - coding->source; | |
| 6586 coding->consumed_char = pos - coding->src_pos; | |
| 6587 coding->charbuf_used = buf - coding->charbuf; | |
| 6588 coding->chars_at_source = 0; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6589 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6590 |
| 88365 | 6591 |
| 6592 /* Encode the text at CODING->src_object into CODING->dst_object. | |
| 6593 CODING->src_object is a buffer or a string. | |
| 6594 CODING->dst_object is a buffer or nil. | |
| 6595 | |
| 6596 If CODING->src_object is a buffer, it must be the current buffer. | |
| 6597 In this case, if CODING->src_pos is positive, it is a position of | |
| 6598 the source text in the buffer, otherwise. the source text is in the | |
| 6599 gap area of the buffer, and coding->src_pos specifies the offset of | |
| 6600 the text from GPT (which must be the same as PT). If this is the | |
| 6601 same buffer as CODING->dst_object, CODING->src_pos must be | |
| 6602 negative and CODING should not have `pre-write-conversion'. | |
| 6603 | |
| 6604 If CODING->src_object is a string, CODING should not have | |
| 6605 `pre-write-conversion'. | |
| 6606 | |
| 6607 If CODING->dst_object is a buffer, the encoded data is inserted at | |
| 6608 the current point of that buffer. | |
| 6609 | |
| 6610 If CODING->dst_object is nil, the encoded data is placed at the | |
| 6611 memory area specified by CODING->destination. */ | |
| 6612 | |
| 6613 static int | |
| 6614 encode_coding (coding) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6615 struct coding_system *coding; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6616 { |
| 88365 | 6617 Lisp_Object attrs; |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
6618 Lisp_Object translation_table; |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
6619 int max_lookup; |
| 88365 | 6620 |
| 6621 attrs = CODING_ID_ATTRS (coding->id); | |
|
89933
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
6622 if (coding->encoder == encode_coding_raw_text) |
|
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
6623 translation_table = Qnil, max_lookup = 0; |
|
42661
e85e4d9494b1
(code_convert_region): Don't copy old text if undo disabled.
Richard M. Stallman <rms@gnu.org>
parents:
42105
diff
changeset
|
6624 else |
|
89933
48af0ea7d387
(setup_coding_system): Set coding->common_flags
Kenichi Handa <handa@m17n.org>
parents:
89924
diff
changeset
|
6625 translation_table = get_translation_table (attrs, 1, &max_lookup); |
| 88365 | 6626 |
| 6627 if (BUFFERP (coding->dst_object)) | |
| 6628 { | |
| 6629 set_buffer_internal (XBUFFER (coding->dst_object)); | |
| 6630 coding->dst_multibyte | |
| 6631 = ! NILP (current_buffer->enable_multibyte_characters); | |
| 6632 } | |
| 6633 | |
| 6634 coding->consumed = coding->consumed_char = 0; | |
| 6635 coding->produced = coding->produced_char = 0; | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6636 record_conversion_result (coding, CODING_RESULT_SUCCESS); |
| 88365 | 6637 coding->errors = 0; |
| 6638 | |
| 6639 ALLOC_CONVERSION_WORK_AREA (coding); | |
| 6640 | |
| 6641 do { | |
| 6642 coding_set_source (coding); | |
|
89859
b706c5ee6492
(get_translation_table): New arg max_lookup. Caller changed.
Kenichi Handa <handa@m17n.org>
parents:
89858
diff
changeset
|
6643 consume_chars (coding, translation_table, max_lookup); |
| 88365 | 6644 coding_set_destination (coding); |
| 6645 (*(coding->encoder)) (coding); | |
| 6646 } while (coding->consumed_char < coding->src_chars); | |
| 6647 | |
|
90809
3c52757d5f6e
(produce_chars): Don't call insert_from_gap if no
Kenichi Handa <handa@m17n.org>
parents:
90772
diff
changeset
|
6648 if (BUFFERP (coding->dst_object) && coding->produced_char > 0) |
| 88365 | 6649 insert_from_gap (coding->produced_char, coding->produced); |
| 6650 | |
| 6651 return (coding->result); | |
| 6652 } | |
| 6653 | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6654 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6655 /* Name (or base name) of work buffer for code conversion. */ |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6656 static Lisp_Object Vcode_conversion_workbuf_name; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6657 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6658 /* A working buffer used by the top level conversion. Once it is |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6659 created, it is never destroyed. It has the name |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6660 Vcode_conversion_workbuf_name. The other working buffers are |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6661 destroyed after the use is finished, and their names are modified |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6662 versions of Vcode_conversion_workbuf_name. */ |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6663 static Lisp_Object Vcode_conversion_reused_workbuf; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6664 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6665 /* 1 iff Vcode_conversion_reused_workbuf is already in use. */ |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6666 static int reused_workbuf_in_use; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6667 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6668 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6669 /* Return a working buffer of code convesion. MULTIBYTE specifies the |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6670 multibyteness of returning buffer. */ |
| 88365 | 6671 |
|
89863
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
6672 static Lisp_Object |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6673 make_conversion_work_buffer (multibyte) |
|
89863
428fc37b2ae6
Add many prototypes for static functions.
Kenichi Handa <handa@m17n.org>
parents:
89861
diff
changeset
|
6674 int multibyte; |
| 88365 | 6675 { |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6676 Lisp_Object name, workbuf; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6677 struct buffer *current; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6678 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6679 if (reused_workbuf_in_use++) |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6680 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6681 name = Fgenerate_new_buffer_name (Vcode_conversion_workbuf_name, Qnil); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6682 workbuf = Fget_buffer_create (name); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6683 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6684 else |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6685 { |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6686 name = Vcode_conversion_workbuf_name; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6687 workbuf = Fget_buffer_create (name); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6688 if (NILP (Vcode_conversion_reused_workbuf)) |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6689 Vcode_conversion_reused_workbuf = workbuf; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6690 } |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6691 current = current_buffer; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6692 set_buffer_internal (XBUFFER (workbuf)); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6693 Ferase_buffer (); |
| 88365 | 6694 current_buffer->undo_list = Qt; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6695 current_buffer->enable_multibyte_characters = multibyte ? Qt : Qnil; |
| 88365 | 6696 set_buffer_internal (current); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6697 return workbuf; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6698 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6699 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6700 |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6701 static Lisp_Object |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6702 code_conversion_restore (arg) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6703 Lisp_Object arg; |
|
26067
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
6704 { |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6705 Lisp_Object current, workbuf; |
|
90263
80fb4c061e99
(code_conversion_restore): GCPRO arg.
Kenichi Handa <handa@m17n.org>
parents:
90261
diff
changeset
|
6706 struct gcpro gcpro1; |
|
80fb4c061e99
(code_conversion_restore): GCPRO arg.
Kenichi Handa <handa@m17n.org>
parents:
90261
diff
changeset
|
6707 |
|
80fb4c061e99
(code_conversion_restore): GCPRO arg.
Kenichi Handa <handa@m17n.org>
parents:
90261
diff
changeset
|
6708 GCPRO1 (arg); |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6709 current = XCAR (arg); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6710 workbuf = XCDR (arg); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6711 if (! NILP (workbuf)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6712 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6713 if (EQ (workbuf, Vcode_conversion_reused_workbuf)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6714 reused_workbuf_in_use = 0; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6715 else if (! NILP (Fbuffer_live_p (workbuf))) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6716 Fkill_buffer (workbuf); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6717 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6718 set_buffer_internal (XBUFFER (current)); |
|
90263
80fb4c061e99
(code_conversion_restore): GCPRO arg.
Kenichi Handa <handa@m17n.org>
parents:
90261
diff
changeset
|
6719 UNGCPRO; |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6720 return Qnil; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6721 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6722 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6723 Lisp_Object |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6724 code_conversion_save (with_work_buf, multibyte) |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6725 int with_work_buf, multibyte; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6726 { |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6727 Lisp_Object workbuf = Qnil; |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6728 |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6729 if (with_work_buf) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6730 workbuf = make_conversion_work_buffer (multibyte); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6731 record_unwind_protect (code_conversion_restore, |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6732 Fcons (Fcurrent_buffer (), workbuf)); |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6733 return workbuf; |
| 17052 | 6734 } |
| 6735 | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6736 int |
| 88365 | 6737 decode_coding_gap (coding, chars, bytes) |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
6738 struct coding_system *coding; |
| 88365 | 6739 EMACS_INT chars, bytes; |
| 6740 { | |
| 6741 int count = specpdl_ptr - specpdl; | |
|
89448
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6742 Lisp_Object attrs; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6743 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6744 code_conversion_save (0, 0); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6745 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6746 coding->src_object = Fcurrent_buffer (); |
| 88365 | 6747 coding->src_chars = chars; |
| 6748 coding->src_bytes = bytes; | |
| 6749 coding->src_pos = -chars; | |
| 6750 coding->src_pos_byte = -bytes; | |
| 6751 coding->src_multibyte = chars < bytes; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6752 coding->dst_object = coding->src_object; |
| 88365 | 6753 coding->dst_pos = PT; |
| 6754 coding->dst_pos_byte = PT_BYTE; | |
|
88443
6b86cf30a0b9
(produce_chars): Set the variable `multibytep' correctly.
Kenichi Handa <handa@m17n.org>
parents:
88438
diff
changeset
|
6755 coding->dst_multibyte = ! NILP (current_buffer->enable_multibyte_characters); |
| 88365 | 6756 |
| 6757 if (CODING_REQUIRE_DETECTION (coding)) | |
| 6758 detect_coding (coding); | |
| 89483 | 6759 |
|
90350
60eaefb08cf7
(DECODE_COMPOSITION_START): If the source is short, set
Kenichi Handa <handa@m17n.org>
parents:
90346
diff
changeset
|
6760 coding->mode |= CODING_MODE_LAST_BLOCK; |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
6761 current_buffer->text->inhibit_shrinking = 1; |
| 88365 | 6762 decode_coding (coding); |
|
90772
b15334b4a9c3
(coding_alloc_by_making_gap): New arg offset.
Kenichi Handa <handa@m17n.org>
parents:
90737
diff
changeset
|
6763 current_buffer->text->inhibit_shrinking = 0; |
| 88365 | 6764 |
|
89448
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6765 attrs = CODING_ID_ATTRS (coding->id); |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6766 if (! NILP (CODING_ATTR_POST_READ (attrs))) |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6767 { |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6768 EMACS_INT prev_Z = Z, prev_Z_BYTE = Z_BYTE; |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6769 Lisp_Object val; |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6770 |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6771 TEMP_SET_PT_BOTH (coding->dst_pos, coding->dst_pos_byte); |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6772 val = call1 (CODING_ATTR_POST_READ (attrs), |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6773 make_number (coding->produced_char)); |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6774 CHECK_NATNUM (val); |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6775 coding->produced_char += Z - prev_Z; |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6776 coding->produced += Z_BYTE - prev_Z_BYTE; |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6777 } |
|
de8b460070cc
(setup_coding_system): If coding has
Kenichi Handa <handa@m17n.org>
parents:
89446
diff
changeset
|
6778 |
| 88365 | 6779 unbind_to (count, Qnil); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
6780 return coding->result; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6781 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6782 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6783 int |
| 88365 | 6784 encode_coding_gap (coding, chars, bytes) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6785 struct coding_system *coding; |
| 88365 | 6786 EMACS_INT chars, bytes; |
| 26847 | 6787 { |
| 88365 | 6788 int count = specpdl_ptr - specpdl; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6789 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6790 code_conversion_save (0, 0); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6791 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6792 coding->src_object = Fcurrent_buffer (); |
| 88365 | 6793 coding->src_chars = chars; |
| 6794 coding->src_bytes = bytes; | |
| 6795 coding->src_pos = -chars; | |
| 6796 coding->src_pos_byte = -bytes; | |
| 6797 coding->src_multibyte = chars < bytes; | |
| 6798 coding->dst_object = coding->src_object; | |
| 6799 coding->dst_pos = PT; | |
| 6800 coding->dst_pos_byte = PT_BYTE; | |
| 6801 | |
| 6802 encode_coding (coding); | |
| 6803 | |
| 6804 unbind_to (count, Qnil); | |
| 6805 return coding->result; | |
| 26847 | 6806 } |
| 6807 | |
| 88365 | 6808 |
| 6809 /* Decode the text in the range FROM/FROM_BYTE and TO/TO_BYTE in | |
| 6810 SRC_OBJECT into DST_OBJECT by coding context CODING. | |
| 6811 | |
| 6812 SRC_OBJECT is a buffer, a string, or Qnil. | |
| 6813 | |
| 6814 If it is a buffer, the text is at point of the buffer. FROM and TO | |
| 6815 are positions in the buffer. | |
| 6816 | |
| 6817 If it is a string, the text is at the beginning of the string. | |
| 6818 FROM and TO are indices to the string. | |
| 6819 | |
| 6820 If it is nil, the text is at coding->source. FROM and TO are | |
| 6821 indices to coding->source. | |
| 6822 | |
| 6823 DST_OBJECT is a buffer, Qt, or Qnil. | |
| 6824 | |
| 6825 If it is a buffer, the decoded text is inserted at point of the | |
| 6826 buffer. If the buffer is the same as SRC_OBJECT, the source text | |
| 6827 is deleted. | |
| 6828 | |
| 6829 If it is Qt, a string is made from the decoded text, and | |
| 6830 set in CODING->dst_object. | |
| 6831 | |
| 6832 If it is Qnil, the decoded text is stored at CODING->destination. | |
|
89418
a9c2b3712863
(coding_set_source): Fix for the case that the current
Kenichi Handa <handa@m17n.org>
parents:
89404
diff
changeset
|
6833 The caller must allocate CODING->dst_bytes bytes at |
| 88365 | 6834 CODING->destination by xmalloc. If the decoded text is longer than |
| 6835 CODING->dst_bytes, CODING->destination is relocated by xrealloc. | |
| 6836 */ | |
| 26847 | 6837 |
| 6838 void | |
| 88365 | 6839 decode_coding_object (coding, src_object, from, from_byte, to, to_byte, |
| 6840 dst_object) | |
| 26847 | 6841 struct coding_system *coding; |
| 88365 | 6842 Lisp_Object src_object; |
| 6843 EMACS_INT from, from_byte, to, to_byte; | |
| 6844 Lisp_Object dst_object; | |
| 26847 | 6845 { |
| 88365 | 6846 int count = specpdl_ptr - specpdl; |
| 6847 unsigned char *destination; | |
| 6848 EMACS_INT dst_bytes; | |
| 6849 EMACS_INT chars = to - from; | |
| 6850 EMACS_INT bytes = to_byte - from_byte; | |
| 6851 Lisp_Object attrs; | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6852 Lisp_Object buffer; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6853 int saved_pt = -1, saved_pt_byte; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6854 |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6855 buffer = Fcurrent_buffer (); |
| 88365 | 6856 |
| 6857 if (NILP (dst_object)) | |
| 6858 { | |
| 6859 destination = coding->destination; | |
| 6860 dst_bytes = coding->dst_bytes; | |
| 6861 } | |
| 6862 | |
| 6863 coding->src_object = src_object; | |
| 6864 coding->src_chars = chars; | |
| 6865 coding->src_bytes = bytes; | |
| 6866 coding->src_multibyte = chars < bytes; | |
| 6867 | |
| 6868 if (STRINGP (src_object)) | |
| 6869 { | |
| 6870 coding->src_pos = from; | |
| 6871 coding->src_pos_byte = from_byte; | |
| 6872 } | |
| 6873 else if (BUFFERP (src_object)) | |
| 6874 { | |
| 6875 set_buffer_internal (XBUFFER (src_object)); | |
| 6876 if (from != GPT) | |
| 6877 move_gap_both (from, from_byte); | |
| 6878 if (EQ (src_object, dst_object)) | |
| 26847 | 6879 { |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6880 saved_pt = PT, saved_pt_byte = PT_BYTE; |
| 88365 | 6881 TEMP_SET_PT_BOTH (from, from_byte); |
| 6882 del_range_both (from, from_byte, to, to_byte, 1); | |
| 6883 coding->src_pos = -chars; | |
| 6884 coding->src_pos_byte = -bytes; | |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
6885 } |
|
42661
e85e4d9494b1
(code_convert_region): Don't copy old text if undo disabled.
Richard M. Stallman <rms@gnu.org>
parents:
42105
diff
changeset
|
6886 else |
|
e85e4d9494b1
(code_convert_region): Don't copy old text if undo disabled.
Richard M. Stallman <rms@gnu.org>
parents:
42105
diff
changeset
|
6887 { |
| 88365 | 6888 coding->src_pos = from; |
| 6889 coding->src_pos_byte = from_byte; | |
|
29985
c17e78d8c720
(code_convert_region): Even if the length of text is
Kenichi Handa <handa@m17n.org>
parents:
29932
diff
changeset
|
6890 } |
| 88365 | 6891 } |
| 6892 | |
| 6893 if (CODING_REQUIRE_DETECTION (coding)) | |
| 6894 detect_coding (coding); | |
| 6895 attrs = CODING_ID_ATTRS (coding->id); | |
| 6896 | |
|
89418
a9c2b3712863
(coding_set_source): Fix for the case that the current
Kenichi Handa <handa@m17n.org>
parents:
89404
diff
changeset
|
6897 if (EQ (dst_object, Qt) |
|
a9c2b3712863
(coding_set_source): Fix for the case that the current
Kenichi Handa <handa@m17n.org>
parents:
89404
diff
changeset
|
6898 || (! NILP (CODING_ATTR_POST_READ (attrs)) |
|
a9c2b3712863
(coding_set_source): Fix for the case that the current
Kenichi Handa <handa@m17n.org>
parents:
89404
diff
changeset
|
6899 && NILP (dst_object))) |
| 88365 | 6900 { |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6901 coding->dst_object = code_conversion_save (1, 1); |
| 88365 | 6902 coding->dst_pos = BEG; |
| 6903 coding->dst_pos_byte = BEG_BYTE; | |
| 6904 coding->dst_multibyte = 1; | |
| 6905 } | |
| 6906 else if (BUFFERP (dst_object)) | |
| 6907 { | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6908 code_conversion_save (0, 0); |
| 88365 | 6909 coding->dst_object = dst_object; |
| 6910 coding->dst_pos = BUF_PT (XBUFFER (dst_object)); | |
| 6911 coding->dst_pos_byte = BUF_PT_BYTE (XBUFFER (dst_object)); | |
| 6912 coding->dst_multibyte | |
| 6913 = ! NILP (XBUFFER (dst_object)->enable_multibyte_characters); | |
| 6914 } | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
6915 else |
|
29172
46ad5a027334
(run_pre_post_conversion_on_str): Set point to the
Kenichi Handa <handa@m17n.org>
parents:
29093
diff
changeset
|
6916 { |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
6917 code_conversion_save (0, 0); |
| 88365 | 6918 coding->dst_object = Qnil; |
| 6919 coding->dst_multibyte = 1; | |
| 6920 } | |
| 6921 | |
| 6922 decode_coding (coding); | |
| 6923 | |
| 6924 if (BUFFERP (coding->dst_object)) | |
| 6925 set_buffer_internal (XBUFFER (coding->dst_object)); | |
| 6926 | |
| 6927 if (! NILP (CODING_ATTR_POST_READ (attrs))) | |
| 6928 { | |
| 6929 struct gcpro gcpro1, gcpro2; | |
| 6930 EMACS_INT prev_Z = Z, prev_Z_BYTE = Z_BYTE; | |
| 6931 Lisp_Object val; | |
| 6932 | |
|
88506
a7f0d13affa5
(decode_coding_object): Move point to coding->dst_pos before
Kenichi Handa <handa@m17n.org>
parents:
88497
diff
changeset
|
6933 TEMP_SET_PT_BOTH (coding->dst_pos, coding->dst_pos_byte); |
| 88365 | 6934 GCPRO2 (coding->src_object, coding->dst_object); |
|
90131
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
6935 val = safe_call1 (CODING_ATTR_POST_READ (attrs), |
|
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
6936 make_number (coding->produced_char)); |
| 88365 | 6937 UNGCPRO; |
| 6938 CHECK_NATNUM (val); | |
| 6939 coding->produced_char += Z - prev_Z; | |
| 6940 coding->produced += Z_BYTE - prev_Z_BYTE; | |
| 6941 } | |
| 6942 | |
| 6943 if (EQ (dst_object, Qt)) | |
| 6944 { | |
| 6945 coding->dst_object = Fbuffer_string (); | |
| 6946 } | |
| 6947 else if (NILP (dst_object) && BUFFERP (coding->dst_object)) | |
| 6948 { | |
| 6949 set_buffer_internal (XBUFFER (coding->dst_object)); | |
| 6950 if (dst_bytes < coding->produced) | |
|
42105
09cc243e2d14
(code_convert_region): Update coding->cmp_data->char_offset
Richard M. Stallman <rms@gnu.org>
parents:
42104
diff
changeset
|
6951 { |
| 88365 | 6952 destination |
| 6953 = (unsigned char *) xrealloc (destination, coding->produced); | |
| 6954 if (! destination) | |
| 26847 | 6955 { |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6956 record_conversion_result (coding, |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6957 CODING_RESULT_INSUFFICIENT_DST); |
| 88365 | 6958 unbind_to (count, Qnil); |
| 6959 return; | |
| 26847 | 6960 } |
| 88365 | 6961 if (BEGV < GPT && GPT < BEGV + coding->produced_char) |
| 6962 move_gap_both (BEGV, BEGV_BYTE); | |
| 6963 bcopy (BEGV_ADDR, destination, coding->produced); | |
| 6964 coding->destination = destination; | |
|
23279
ca159e828a68
(ccl_coding_driver): If ccl_driver is interrupted by a
Kenichi Handa <handa@m17n.org>
parents:
23258
diff
changeset
|
6965 } |
| 88365 | 6966 } |
| 6967 | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6968 if (saved_pt >= 0) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6969 { |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6970 /* This is the case of: |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6971 (BUFFERP (src_object) && EQ (src_object, dst_object)) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6972 As we have moved PT while replacing the original buffer |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6973 contents, we must recover it now. */ |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6974 set_buffer_internal (XBUFFER (src_object)); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6975 if (saved_pt < from) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6976 TEMP_SET_PT_BOTH (saved_pt, saved_pt_byte); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6977 else if (saved_pt < from + chars) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6978 TEMP_SET_PT_BOTH (from, from_byte); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6979 else if (! NILP (current_buffer->enable_multibyte_characters)) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6980 TEMP_SET_PT_BOTH (saved_pt + (coding->produced_char - chars), |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6981 saved_pt_byte + (coding->produced - bytes)); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6982 else |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6983 TEMP_SET_PT_BOTH (saved_pt + (coding->produced - bytes), |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6984 saved_pt_byte + (coding->produced - bytes)); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6985 } |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
6986 |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
6987 unbind_to (count, coding->dst_object); |
| 88365 | 6988 } |
| 6989 | |
| 26847 | 6990 |
|
29275
b4ea9178e480
(DECODE_COMPOSITION_START): If coding->cmp_data is not
Kenichi Handa <handa@m17n.org>
parents:
29247
diff
changeset
|
6991 void |
| 88365 | 6992 encode_coding_object (coding, src_object, from, from_byte, to, to_byte, |
| 6993 dst_object) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6994 struct coding_system *coding; |
| 88365 | 6995 Lisp_Object src_object; |
| 6996 EMACS_INT from, from_byte, to, to_byte; | |
| 6997 Lisp_Object dst_object; | |
| 6998 { | |
| 6999 int count = specpdl_ptr - specpdl; | |
| 7000 EMACS_INT chars = to - from; | |
| 7001 EMACS_INT bytes = to_byte - from_byte; | |
| 7002 Lisp_Object attrs; | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7003 Lisp_Object buffer; |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7004 int saved_pt = -1, saved_pt_byte; |
|
90231
8be9e4c6d687
(encode_coding_object): If a pre-write-conversion
Kenichi Handa <handa@m17n.org>
parents:
90224
diff
changeset
|
7005 int kill_src_buffer = 0; |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7006 |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7007 buffer = Fcurrent_buffer (); |
| 88365 | 7008 |
| 7009 coding->src_object = src_object; | |
| 7010 coding->src_chars = chars; | |
| 7011 coding->src_bytes = bytes; | |
| 7012 coding->src_multibyte = chars < bytes; | |
| 7013 | |
| 7014 attrs = CODING_ID_ATTRS (coding->id); | |
| 7015 | |
| 7016 if (! NILP (CODING_ATTR_PRE_WRITE (attrs))) | |
|
21062
839b22ad1e42
(code_convert_region): Handle the case that codes
Kenichi Handa <handa@m17n.org>
parents:
20999
diff
changeset
|
7017 { |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7018 coding->src_object = code_conversion_save (1, coding->src_multibyte); |
| 88365 | 7019 set_buffer_internal (XBUFFER (coding->src_object)); |
| 7020 if (STRINGP (src_object)) | |
| 7021 insert_from_string (src_object, from, from_byte, chars, bytes, 0); | |
| 7022 else if (BUFFERP (src_object)) | |
| 7023 insert_from_buffer (XBUFFER (src_object), from, chars, 0); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7024 else |
| 88365 | 7025 insert_1_both (coding->source + from, chars, bytes, 0, 0, 0); |
| 7026 | |
| 7027 if (EQ (src_object, dst_object)) | |
| 7028 { | |
| 7029 set_buffer_internal (XBUFFER (src_object)); | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7030 saved_pt = PT, saved_pt_byte = PT_BYTE; |
| 88365 | 7031 del_range_both (from, from_byte, to, to_byte, 1); |
| 7032 set_buffer_internal (XBUFFER (coding->src_object)); | |
| 7033 } | |
| 7034 | |
|
90131
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
7035 { |
|
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
7036 Lisp_Object args[3]; |
|
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
7037 |
|
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
7038 args[0] = CODING_ATTR_PRE_WRITE (attrs); |
|
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
7039 args[1] = make_number (BEG); |
|
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
7040 args[2] = make_number (Z); |
|
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
7041 safe_call (3, args); |
|
503a3c779486
(decode_coding_object): Use safe_call1 instead of call1.
Kenichi Handa <handa@m17n.org>
parents:
90127
diff
changeset
|
7042 } |
|
90231
8be9e4c6d687
(encode_coding_object): If a pre-write-conversion
Kenichi Handa <handa@m17n.org>
parents:
90224
diff
changeset
|
7043 if (XBUFFER (coding->src_object) != current_buffer) |
|
8be9e4c6d687
(encode_coding_object): If a pre-write-conversion
Kenichi Handa <handa@m17n.org>
parents:
90224
diff
changeset
|
7044 kill_src_buffer = 1; |
|
88510
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
7045 coding->src_object = Fcurrent_buffer (); |
| 88365 | 7046 if (BEG != GPT) |
| 7047 move_gap_both (BEG, BEG_BYTE); | |
| 7048 coding->src_chars = Z - BEG; | |
| 7049 coding->src_bytes = Z_BYTE - BEG_BYTE; | |
| 7050 coding->src_pos = BEG; | |
| 7051 coding->src_pos_byte = BEG_BYTE; | |
| 7052 coding->src_multibyte = Z < Z_BYTE; | |
| 7053 } | |
| 7054 else if (STRINGP (src_object)) | |
| 7055 { | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7056 code_conversion_save (0, 0); |
| 88365 | 7057 coding->src_pos = from; |
| 7058 coding->src_pos_byte = from_byte; | |
| 7059 } | |
| 7060 else if (BUFFERP (src_object)) | |
| 7061 { | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7062 code_conversion_save (0, 0); |
| 88365 | 7063 set_buffer_internal (XBUFFER (src_object)); |
| 7064 if (EQ (src_object, dst_object)) | |
| 7065 { | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7066 saved_pt = PT, saved_pt_byte = PT_BYTE; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7067 coding->src_object = del_range_1 (from, to, 1, 1); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7068 coding->src_pos = 0; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7069 coding->src_pos_byte = 0; |
| 88365 | 7070 } |
|
23514
7bad909cd6f1
(setup_coding_system): Fix setting up
Kenichi Handa <handa@m17n.org>
parents:
23475
diff
changeset
|
7071 else |
|
42105
09cc243e2d14
(code_convert_region): Update coding->cmp_data->char_offset
Richard M. Stallman <rms@gnu.org>
parents:
42104
diff
changeset
|
7072 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7073 if (from < GPT && to >= GPT) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7074 move_gap_both (from, from_byte); |
| 88365 | 7075 coding->src_pos = from; |
| 7076 coding->src_pos_byte = from_byte; | |
| 7077 } | |
|
64308
93129de4b8a4
(code_convert_region_unwind): ARG is changed to a cons.
Kenichi Handa <handa@m17n.org>
parents:
64251
diff
changeset
|
7078 } |
|
93129de4b8a4
(code_convert_region_unwind): ARG is changed to a cons.
Kenichi Handa <handa@m17n.org>
parents:
64251
diff
changeset
|
7079 else |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7080 code_conversion_save (0, 0); |
| 88365 | 7081 |
| 7082 if (BUFFERP (dst_object)) | |
| 7083 { | |
| 7084 coding->dst_object = dst_object; | |
|
89042
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7085 if (EQ (src_object, dst_object)) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7086 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7087 coding->dst_pos = from; |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7088 coding->dst_pos_byte = from_byte; |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7089 } |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7090 else |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7091 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7092 coding->dst_pos = BUF_PT (XBUFFER (dst_object)); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7093 coding->dst_pos_byte = BUF_PT_BYTE (XBUFFER (dst_object)); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
7094 } |
| 88365 | 7095 coding->dst_multibyte |
| 7096 = ! NILP (XBUFFER (dst_object)->enable_multibyte_characters); | |
| 7097 } | |
| 7098 else if (EQ (dst_object, Qt)) | |
| 7099 { | |
| 7100 coding->dst_object = Qnil; | |
| 7101 coding->dst_bytes = coding->src_chars; | |
|
88510
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
7102 if (coding->dst_bytes == 0) |
|
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
7103 coding->dst_bytes = 1; |
|
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
7104 coding->destination = (unsigned char *) xmalloc (coding->dst_bytes); |
| 88365 | 7105 coding->dst_multibyte = 0; |
|
65506
f376635f5061
(code_convert_region_unwind): Argument format changed.
Kenichi Handa <handa@m17n.org>
parents:
64770
diff
changeset
|
7106 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
7107 else |
|
29172
46ad5a027334
(run_pre_post_conversion_on_str): Set point to the
Kenichi Handa <handa@m17n.org>
parents:
29093
diff
changeset
|
7108 { |
| 88365 | 7109 coding->dst_object = Qnil; |
| 7110 coding->dst_multibyte = 0; | |
| 7111 } | |
| 7112 | |
| 7113 encode_coding (coding); | |
| 7114 | |
| 7115 if (EQ (dst_object, Qt)) | |
| 7116 { | |
| 7117 if (BUFFERP (coding->dst_object)) | |
| 7118 coding->dst_object = Fbuffer_string (); | |
|
23514
7bad909cd6f1
(setup_coding_system): Fix setting up
Kenichi Handa <handa@m17n.org>
parents:
23475
diff
changeset
|
7119 else |
| 88365 | 7120 { |
| 7121 coding->dst_object | |
| 7122 = make_unibyte_string ((char *) coding->destination, | |
| 7123 coding->produced); | |
| 7124 xfree (coding->destination); | |
| 7125 } | |
| 7126 } | |
| 7127 | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7128 if (saved_pt >= 0) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7129 { |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7130 /* This is the case of: |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7131 (BUFFERP (src_object) && EQ (src_object, dst_object)) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7132 As we have moved PT while replacing the original buffer |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7133 contents, we must recover it now. */ |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7134 set_buffer_internal (XBUFFER (src_object)); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7135 if (saved_pt < from) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7136 TEMP_SET_PT_BOTH (saved_pt, saved_pt_byte); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7137 else if (saved_pt < from + chars) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7138 TEMP_SET_PT_BOTH (from, from_byte); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7139 else if (! NILP (current_buffer->enable_multibyte_characters)) |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7140 TEMP_SET_PT_BOTH (saved_pt + (coding->produced_char - chars), |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7141 saved_pt_byte + (coding->produced - bytes)); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7142 else |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7143 TEMP_SET_PT_BOTH (saved_pt + (coding->produced - bytes), |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7144 saved_pt_byte + (coding->produced - bytes)); |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7145 } |
|
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
7146 |
|
90231
8be9e4c6d687
(encode_coding_object): If a pre-write-conversion
Kenichi Handa <handa@m17n.org>
parents:
90224
diff
changeset
|
7147 if (kill_src_buffer) |
|
8be9e4c6d687
(encode_coding_object): If a pre-write-conversion
Kenichi Handa <handa@m17n.org>
parents:
90224
diff
changeset
|
7148 Fkill_buffer (coding->src_object); |
| 88365 | 7149 unbind_to (count, Qnil); |
|
58637
ff8a37b5299b
(Vcode_conversion_workbuf_name): New variable.
Kenichi Handa <handa@m17n.org>
parents:
58502
diff
changeset
|
7150 } |
|
ff8a37b5299b
(Vcode_conversion_workbuf_name): New variable.
Kenichi Handa <handa@m17n.org>
parents:
58502
diff
changeset
|
7151 |
|
ff8a37b5299b
(Vcode_conversion_workbuf_name): New variable.
Kenichi Handa <handa@m17n.org>
parents:
58502
diff
changeset
|
7152 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
7153 Lisp_Object |
| 88365 | 7154 preferred_coding_system () |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7155 { |
| 88365 | 7156 int id = coding_categories[coding_priorities[0]].id; |
| 7157 | |
| 7158 return CODING_ID_NAME (id); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7159 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7160 |
| 17052 | 7161 |
| 7162 #ifdef emacs | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
7163 /*** 8. Emacs Lisp library functions ***/ |
| 17052 | 7164 |
| 7165 DEFUN ("coding-system-p", Fcoding_system_p, Scoding_system_p, 1, 1, 0, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7166 doc: /* Return t if OBJECT is nil or a coding-system. |
| 88365 | 7167 See the documentation of `define-coding-system' for information |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7168 about coding-system objects. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7169 (obj) |
| 17052 | 7170 Lisp_Object obj; |
| 7171 { | |
|
90272
f1df126ec7de
Sync to HEAD for handling autoload-coding-system.
Kenichi Handa <handa@m17n.org>
parents:
90263
diff
changeset
|
7172 if (NILP (obj) |
|
f1df126ec7de
Sync to HEAD for handling autoload-coding-system.
Kenichi Handa <handa@m17n.org>
parents:
90263
diff
changeset
|
7173 || CODING_SYSTEM_ID (obj) >= 0) |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
7174 return Qt; |
|
90272
f1df126ec7de
Sync to HEAD for handling autoload-coding-system.
Kenichi Handa <handa@m17n.org>
parents:
90263
diff
changeset
|
7175 if (! SYMBOLP (obj) |
|
f1df126ec7de
Sync to HEAD for handling autoload-coding-system.
Kenichi Handa <handa@m17n.org>
parents:
90263
diff
changeset
|
7176 || NILP (Fget (obj, Qcoding_system_define_form))) |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
7177 return Qnil; |
|
90272
f1df126ec7de
Sync to HEAD for handling autoload-coding-system.
Kenichi Handa <handa@m17n.org>
parents:
90263
diff
changeset
|
7178 return Qt; |
| 17052 | 7179 } |
| 7180 | |
|
17717
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
7181 DEFUN ("read-non-nil-coding-system", Fread_non_nil_coding_system, |
|
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
7182 Sread_non_nil_coding_system, 1, 1, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7183 doc: /* Read a coding system from the minibuffer, prompting with string PROMPT. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7184 (prompt) |
| 17052 | 7185 Lisp_Object prompt; |
| 7186 { | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
7187 Lisp_Object val; |
|
17717
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
7188 do |
|
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
7189 { |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
7190 val = Fcompleting_read (prompt, Vcoding_system_alist, Qnil, |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
7191 Qt, Qnil, Qcoding_system_history, Qnil, Qnil); |
|
17717
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
7192 } |
|
46370
40db0673e6f0
Most uses of XSTRING combined with STRING_BYTES or indirection changed to
Ken Raeburn <raeburn@raeburn.org>
parents:
46293
diff
changeset
|
7193 while (SCHARS (val) == 0); |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
7194 return (Fintern (val, Qnil)); |
| 17052 | 7195 } |
| 7196 | |
|
19758
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
7197 DEFUN ("read-coding-system", Fread_coding_system, Sread_coding_system, 1, 2, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7198 doc: /* Read a coding system from the minibuffer, prompting with string PROMPT. |
|
85332
bb808ca35bd9
(Qcompletion_ignore_case): New external Lisp_Object.
Glenn Morris <rgm@gnu.org>
parents:
85330
diff
changeset
|
7199 If the user enters null input, return second argument DEFAULT-CODING-SYSTEM. |
|
bb808ca35bd9
(Qcompletion_ignore_case): New external Lisp_Object.
Glenn Morris <rgm@gnu.org>
parents:
85330
diff
changeset
|
7200 Ignores case when completing coding systems (all Emacs coding systems |
|
bb808ca35bd9
(Qcompletion_ignore_case): New external Lisp_Object.
Glenn Morris <rgm@gnu.org>
parents:
85330
diff
changeset
|
7201 are lower-case). */) |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7202 (prompt, default_coding_system) |
|
19758
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
7203 Lisp_Object prompt, default_coding_system; |
| 17052 | 7204 { |
|
19747
bed06df9cbc5
(setup_coding_system, Ffind_operation_coding_system)
Richard M. Stallman <rms@gnu.org>
parents:
19743
diff
changeset
|
7205 Lisp_Object val; |
|
85332
bb808ca35bd9
(Qcompletion_ignore_case): New external Lisp_Object.
Glenn Morris <rgm@gnu.org>
parents:
85330
diff
changeset
|
7206 int count = SPECPDL_INDEX (); |
|
bb808ca35bd9
(Qcompletion_ignore_case): New external Lisp_Object.
Glenn Morris <rgm@gnu.org>
parents:
85330
diff
changeset
|
7207 |
|
19758
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
7208 if (SYMBOLP (default_coding_system)) |
|
45396
cab845213388
* coding.c (Fread_coding_system, code_convert_region1)
Ken Raeburn <raeburn@raeburn.org>
parents:
45239
diff
changeset
|
7209 default_coding_system = SYMBOL_NAME (default_coding_system); |
|
85332
bb808ca35bd9
(Qcompletion_ignore_case): New external Lisp_Object.
Glenn Morris <rgm@gnu.org>
parents:
85330
diff
changeset
|
7210 specbind (Qcompletion_ignore_case, Qt); |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
7211 val = Fcompleting_read (prompt, Vcoding_system_alist, Qnil, |
|
19758
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
7212 Qt, Qnil, Qcoding_system_history, |
|
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
7213 default_coding_system, Qnil); |
|
85332
bb808ca35bd9
(Qcompletion_ignore_case): New external Lisp_Object.
Glenn Morris <rgm@gnu.org>
parents:
85330
diff
changeset
|
7214 unbind_to (count, Qnil); |
|
46370
40db0673e6f0
Most uses of XSTRING combined with STRING_BYTES or indirection changed to
Ken Raeburn <raeburn@raeburn.org>
parents:
46293
diff
changeset
|
7215 return (SCHARS (val) == 0 ? Qnil : Fintern (val, Qnil)); |
| 17052 | 7216 } |
| 7217 | |
| 7218 DEFUN ("check-coding-system", Fcheck_coding_system, Scheck_coding_system, | |
| 7219 1, 1, 0, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7220 doc: /* Check validity of CODING-SYSTEM. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7221 If valid, return CODING-SYSTEM, else signal a `coding-system-error' error. |
| 89892 | 7222 It is valid if it is nil or a symbol defined as a coding system by the |
| 7223 function `define-coding-system'. */) | |
| 88365 | 7224 (coding_system) |
| 17052 | 7225 Lisp_Object coding_system; |
| 7226 { | |
|
52794
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
7227 Lisp_Object define_form; |
|
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
7228 |
|
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
7229 define_form = Fget (coding_system, Qcoding_system_define_form); |
|
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
7230 if (! NILP (define_form)) |
|
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
7231 { |
|
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
7232 Fput (coding_system, Qcoding_system_define_form, Qnil); |
|
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
7233 safe_eval (define_form); |
|
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
7234 } |
| 17052 | 7235 if (!NILP (Fcoding_system_p (coding_system))) |
| 7236 return coding_system; | |
|
71972
eaa3c19b94d2
(Fcheck_coding_system): Use xsignal1. Remove loop.
Kim F. Storm <storm@cua.dk>
parents:
71084
diff
changeset
|
7237 xsignal1 (Qcoding_system_error, coding_system); |
| 17052 | 7238 } |
| 88365 | 7239 |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
7240 |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7241 /* Detect how the bytes at SRC of length SRC_BYTES are encoded. If |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7242 HIGHEST is nonzero, return the coding system of the highest |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7243 priority among the detected coding systems. Otherwize return a |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7244 list of detected coding systems sorted by their priorities. If |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7245 MULTIBYTEP is nonzero, it is assumed that the bytes are in correct |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7246 multibyte form but contains only ASCII and eight-bit chars. |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7247 Otherwise, the bytes are raw bytes. |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7248 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7249 CODING-SYSTEM controls the detection as below: |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7250 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7251 If it is nil, detect both text-format and eol-format. If the |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7252 text-format part of CODING-SYSTEM is already specified |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7253 (e.g. `iso-latin-1'), detect only eol-format. If the eol-format |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7254 part of CODING-SYSTEM is already specified (e.g. `undecided-unix'), |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7255 detect only text-format. */ |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7256 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7257 Lisp_Object |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7258 detect_coding_system (src, src_chars, src_bytes, highest, multibytep, |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7259 coding_system) |
|
46548
cb1914307488
(encode_eol, detect_coding, detect_eol):
Ken Raeburn <raeburn@raeburn.org>
parents:
46462
diff
changeset
|
7260 const unsigned char *src; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7261 int src_chars, src_bytes, highest; |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
7262 int multibytep; |
| 88365 | 7263 Lisp_Object coding_system; |
| 17052 | 7264 { |
| 89483 | 7265 const unsigned char *src_end = src + src_bytes; |
| 88365 | 7266 Lisp_Object attrs, eol_type; |
| 7267 Lisp_Object val; | |
| 7268 struct coding_system coding; | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7269 int id; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7270 struct coding_detection_info detect_info; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7271 enum coding_category base_category; |
| 88365 | 7272 |
| 7273 if (NILP (coding_system)) | |
| 7274 coding_system = Qundecided; | |
| 7275 setup_coding_system (coding_system, &coding); | |
| 7276 attrs = CODING_ID_ATTRS (coding.id); | |
| 7277 eol_type = CODING_ID_EOL_TYPE (coding.id); | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7278 coding_system = CODING_ATTR_BASE_NAME (attrs); |
| 88365 | 7279 |
| 7280 coding.source = src; | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7281 coding.src_chars = src_chars; |
| 88365 | 7282 coding.src_bytes = src_bytes; |
| 7283 coding.src_multibyte = multibytep; | |
| 7284 coding.consumed = 0; | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7285 coding.mode |= CODING_MODE_LAST_BLOCK; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7286 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7287 detect_info.checked = detect_info.found = detect_info.rejected = 0; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7288 |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7289 /* At first, detect text-format if necessary. */ |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7290 base_category = XINT (CODING_ATTR_CATEGORY (attrs)); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7291 if (base_category == coding_category_undecided) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7292 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7293 enum coding_category category; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7294 struct coding_system *this; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7295 int c, i; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7296 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7297 /* Skip all ASCII bytes except for a few ISO2022 controls. */ |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7298 for (i = 0; src < src_end; i++, src++) |
| 17052 | 7299 { |
| 88365 | 7300 c = *src; |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7301 if (c & 0x80) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7302 break; |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7303 if (c < 0x20 |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7304 && (c == ISO_CODE_ESC || c == ISO_CODE_SI || c == ISO_CODE_SO) |
|
90594
a965377e6761
(detect_coding_system): Fix for handling off
Kenichi Handa <handa@m17n.org>
parents:
90587
diff
changeset
|
7305 && ! inhibit_iso_escape_detection) |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7306 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7307 coding.head_ascii = src - coding.source; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7308 if (detect_coding_iso_2022 (&coding, &detect_info)) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7309 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7310 /* We have scanned the whole data. */ |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7311 if (! (detect_info.rejected & CATEGORY_MASK_ISO_7_ELSE)) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7312 /* We didn't find an 8-bit code. */ |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7313 src = src_end; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7314 break; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7315 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7316 } |
| 17052 | 7317 } |
| 88365 | 7318 coding.head_ascii = src - coding.source; |
| 7319 | |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7320 if (src < src_end |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7321 || detect_info.found) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7322 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7323 if (src == src_end) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7324 /* As all bytes are 7-bit, we can ignore non-ISO-2022 codings. */ |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7325 for (i = 0; i < coding_category_raw_text; i++) |
| 88365 | 7326 { |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7327 category = coding_priorities[i]; |
|
90594
a965377e6761
(detect_coding_system): Fix for handling off
Kenichi Handa <handa@m17n.org>
parents:
90587
diff
changeset
|
7328 this = coding_categories + category; |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7329 if (detect_info.found & (1 << category)) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7330 break; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7331 } |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7332 else |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7333 for (i = 0; i < coding_category_raw_text; i++) |
| 88365 | 7334 { |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7335 category = coding_priorities[i]; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7336 this = coding_categories + category; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7337 |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7338 if (this->id < 0) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7339 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7340 /* No coding system of this category is defined. */ |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7341 detect_info.rejected |= (1 << category); |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7342 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7343 else if (category >= coding_category_raw_text) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7344 continue; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7345 else if (detect_info.checked & (1 << category)) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7346 { |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7347 if (highest |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7348 && (detect_info.found & (1 << category))) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7349 break; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7350 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7351 else |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7352 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7353 if ((*(this->detector)) (&coding, &detect_info) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7354 && highest |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7355 && (detect_info.found & (1 << category))) |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7356 { |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7357 if (category == coding_category_utf_16_auto) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7358 { |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7359 if (detect_info.found & CATEGORY_MASK_UTF_16_LE) |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7360 category = coding_category_utf_16_le; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7361 else |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7362 category = coding_category_utf_16_be; |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7363 } |
|
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7364 break; |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7365 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7366 } |
| 88365 | 7367 } |
|
89974
2fef8edebd5c
(detect_coding_utf_16): Don't set detect_info->found if
Kenichi Handa <handa@m17n.org>
parents:
89933
diff
changeset
|
7368 } |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7369 |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7370 if (detect_info.rejected == CATEGORY_MASK_ANY) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7371 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7372 detect_info.found = CATEGORY_MASK_RAW_TEXT; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7373 id = coding_categories[coding_category_raw_text].id; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7374 val = Fcons (make_number (id), Qnil); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7375 } |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7376 else if (! detect_info.rejected && ! detect_info.found) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7377 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7378 detect_info.found = CATEGORY_MASK_ANY; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7379 id = coding_categories[coding_category_undecided].id; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7380 val = Fcons (make_number (id), Qnil); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7381 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7382 else if (highest) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7383 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7384 if (detect_info.found) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7385 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7386 detect_info.found = 1 << category; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7387 val = Fcons (make_number (this->id), Qnil); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7388 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7389 else |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7390 for (i = 0; i < coding_category_raw_text; i++) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7391 if (! (detect_info.rejected & (1 << coding_priorities[i]))) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7392 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7393 detect_info.found = 1 << coding_priorities[i]; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7394 id = coding_categories[coding_priorities[i]].id; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7395 val = Fcons (make_number (id), Qnil); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7396 break; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7397 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7398 } |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7399 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7400 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7401 int mask = detect_info.rejected | detect_info.found; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7402 int found = 0; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7403 val = Qnil; |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7404 |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7405 for (i = coding_category_raw_text - 1; i >= 0; i--) |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7406 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7407 category = coding_priorities[i]; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7408 if (! (mask & (1 << category))) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7409 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7410 found |= 1 << category; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7411 id = coding_categories[category].id; |
|
90594
a965377e6761
(detect_coding_system): Fix for handling off
Kenichi Handa <handa@m17n.org>
parents:
90587
diff
changeset
|
7412 if (id >= 0) |
|
a965377e6761
(detect_coding_system): Fix for handling off
Kenichi Handa <handa@m17n.org>
parents:
90587
diff
changeset
|
7413 val = Fcons (make_number (id), val); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7414 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7415 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7416 for (i = coding_category_raw_text - 1; i >= 0; i--) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7417 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7418 category = coding_priorities[i]; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7419 if (detect_info.found & (1 << category)) |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7420 { |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7421 id = coding_categories[category].id; |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7422 val = Fcons (make_number (id), val); |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7423 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7424 } |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7425 detect_info.found |= found; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7426 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7427 } |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7428 else if (base_category == coding_category_utf_16_auto) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7429 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7430 if (detect_coding_utf_16 (&coding, &detect_info)) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7431 { |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7432 struct coding_system *this; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7433 |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7434 if (detect_info.found & CATEGORY_MASK_UTF_16_LE) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7435 this = coding_categories + coding_category_utf_16_le; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7436 else if (detect_info.found & CATEGORY_MASK_UTF_16_BE) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7437 this = coding_categories + coding_category_utf_16_be; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7438 else if (detect_info.rejected & CATEGORY_MASK_UTF_16_LE_NOSIG) |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7439 this = coding_categories + coding_category_utf_16_be_nosig; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7440 else |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7441 this = coding_categories + coding_category_utf_16_le_nosig; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7442 val = Fcons (make_number (this->id), Qnil); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7443 } |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7444 } |
| 88365 | 7445 else |
| 7446 { | |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7447 detect_info.found = 1 << XINT (CODING_ATTR_CATEGORY (attrs)); |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7448 val = Fcons (make_number (coding.id), Qnil); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7449 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7450 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7451 /* Then, detect eol-format if necessary. */ |
| 88365 | 7452 { |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7453 int normal_eol = -1, utf_16_be_eol = -1, utf_16_le_eol; |
| 88365 | 7454 Lisp_Object tail; |
| 7455 | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7456 if (VECTORP (eol_type)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7457 { |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7458 if (detect_info.found & ~CATEGORY_MASK_UTF_16) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7459 normal_eol = detect_eol (coding.source, src_bytes, |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7460 coding_category_raw_text); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7461 if (detect_info.found & (CATEGORY_MASK_UTF_16_BE |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7462 | CATEGORY_MASK_UTF_16_BE_NOSIG)) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7463 utf_16_be_eol = detect_eol (coding.source, src_bytes, |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7464 coding_category_utf_16_be); |
|
89331
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7465 if (detect_info.found & (CATEGORY_MASK_UTF_16_LE |
|
1892a75ffcac
(CATEGORY_MASK_RAW_TEXT): New macro.
Kenichi Handa <handa@m17n.org>
parents:
89279
diff
changeset
|
7466 | CATEGORY_MASK_UTF_16_LE_NOSIG)) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7467 utf_16_le_eol = detect_eol (coding.source, src_bytes, |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7468 coding_category_utf_16_le); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7469 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7470 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7471 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7472 if (EQ (eol_type, Qunix)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7473 normal_eol = utf_16_be_eol = utf_16_le_eol = EOL_SEEN_LF; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7474 else if (EQ (eol_type, Qdos)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7475 normal_eol = utf_16_be_eol = utf_16_le_eol = EOL_SEEN_CRLF; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7476 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7477 normal_eol = utf_16_be_eol = utf_16_le_eol = EOL_SEEN_CR; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7478 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7479 |
| 88365 | 7480 for (tail = val; CONSP (tail); tail = XCDR (tail)) |
| 7481 { | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7482 enum coding_category category; |
| 88365 | 7483 int this_eol; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7484 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7485 id = XINT (XCAR (tail)); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7486 attrs = CODING_ID_ATTRS (id); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7487 category = XINT (CODING_ATTR_CATEGORY (attrs)); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7488 eol_type = CODING_ID_EOL_TYPE (id); |
| 88365 | 7489 if (VECTORP (eol_type)) |
| 7490 { | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7491 if (category == coding_category_utf_16_be |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7492 || category == coding_category_utf_16_be_nosig) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7493 this_eol = utf_16_be_eol; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7494 else if (category == coding_category_utf_16_le |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7495 || category == coding_category_utf_16_le_nosig) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7496 this_eol = utf_16_le_eol; |
| 88365 | 7497 else |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7498 this_eol = normal_eol; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7499 |
| 88365 | 7500 if (this_eol == EOL_SEEN_LF) |
| 7501 XSETCAR (tail, AREF (eol_type, 0)); | |
| 7502 else if (this_eol == EOL_SEEN_CRLF) | |
| 7503 XSETCAR (tail, AREF (eol_type, 1)); | |
| 7504 else if (this_eol == EOL_SEEN_CR) | |
| 7505 XSETCAR (tail, AREF (eol_type, 2)); | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7506 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7507 XSETCAR (tail, CODING_ID_NAME (id)); |
| 88365 | 7508 } |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7509 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
7510 XSETCAR (tail, CODING_ID_NAME (id)); |
| 88365 | 7511 } |
| 7512 } | |
| 7513 | |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
7514 return (highest ? XCAR (val) : val); |
|
42104
d69c2368e549
(DECODE_COMPOSITION_END): Fixed a typo in the last
Sam Steingold <sds@gnu.org>
parents:
42103
diff
changeset
|
7515 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7516 |
| 88365 | 7517 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7518 DEFUN ("detect-coding-region", Fdetect_coding_region, Sdetect_coding_region, |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7519 2, 3, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7520 doc: /* Detect coding system of the text in the region between START and END. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7521 Return a list of possible coding systems ordered by priority. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7522 |
|
72552
6493d4697ad2
(Fdetect_coding_region, Fdetect_coding_string): Fix
Kenichi Handa <handa@m17n.org>
parents:
72395
diff
changeset
|
7523 If only ASCII characters are found (except for such ISO-2022 control |
|
6493d4697ad2
(Fdetect_coding_region, Fdetect_coding_string): Fix
Kenichi Handa <handa@m17n.org>
parents:
72395
diff
changeset
|
7524 characters ISO-2022 as ESC), it returns a list of single element |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7525 `undecided' or its subsidiary coding system according to a detected |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7526 end-of-line format. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7527 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7528 If optional argument HIGHEST is non-nil, return the coding system of |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7529 highest priority. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7530 (start, end, highest) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7531 Lisp_Object start, end, highest; |
| 17052 | 7532 { |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7533 int from, to; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7534 int from_byte, to_byte; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7535 |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7536 CHECK_NUMBER_COERCE_MARKER (start); |
|
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7537 CHECK_NUMBER_COERCE_MARKER (end); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7538 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7539 validate_region (&start, &end); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7540 from = XINT (start), to = XINT (end); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7541 from_byte = CHAR_TO_BYTE (from); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7542 to_byte = CHAR_TO_BYTE (to); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7543 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7544 if (from < GPT && to >= GPT) |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7545 move_gap_both (to, to_byte); |
| 88365 | 7546 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7547 return detect_coding_system (BYTE_POS_ADDR (from_byte), |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7548 to - from, to_byte - from_byte, |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
7549 !NILP (highest), |
|
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
7550 !NILP (current_buffer |
| 88365 | 7551 ->enable_multibyte_characters), |
| 7552 Qnil); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7553 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7554 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7555 DEFUN ("detect-coding-string", Fdetect_coding_string, Sdetect_coding_string, |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7556 1, 2, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7557 doc: /* Detect coding system of the text in STRING. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7558 Return a list of possible coding systems ordered by priority. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7559 |
|
72552
6493d4697ad2
(Fdetect_coding_region, Fdetect_coding_string): Fix
Kenichi Handa <handa@m17n.org>
parents:
72395
diff
changeset
|
7560 If only ASCII characters are found (except for such ISO-2022 control |
|
6493d4697ad2
(Fdetect_coding_region, Fdetect_coding_string): Fix
Kenichi Handa <handa@m17n.org>
parents:
72395
diff
changeset
|
7561 characters ISO-2022 as ESC), it returns a list of single element |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7562 `undecided' or its subsidiary coding system according to a detected |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7563 end-of-line format. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7564 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7565 If optional argument HIGHEST is non-nil, return the coding system of |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7566 highest priority. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7567 (string, highest) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7568 Lisp_Object string, highest; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7569 { |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7570 CHECK_STRING (string); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7571 |
|
46370
40db0673e6f0
Most uses of XSTRING combined with STRING_BYTES or indirection changed to
Ken Raeburn <raeburn@raeburn.org>
parents:
46293
diff
changeset
|
7572 return detect_coding_system (SDATA (string), |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
7573 SCHARS (string), SBYTES (string), |
| 89483 | 7574 !NILP (highest), STRING_MULTIBYTE (string), |
| 88365 | 7575 Qnil); |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7576 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7577 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7578 |
| 88365 | 7579 static INLINE int |
| 7580 char_encodable_p (c, attrs) | |
| 7581 int c; | |
| 7582 Lisp_Object attrs; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7583 { |
| 88365 | 7584 Lisp_Object tail; |
| 7585 struct charset *charset; | |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7586 Lisp_Object translation_table; |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7587 |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7588 translation_table = CODING_ATTR_TRANS_TBL (attrs); |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
7589 if (! NILP (translation_table)) |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7590 c = translate_char (translation_table, c); |
| 88365 | 7591 for (tail = CODING_ATTR_CHARSET_LIST (attrs); |
| 7592 CONSP (tail); tail = XCDR (tail)) | |
| 7593 { | |
| 7594 charset = CHARSET_FROM_ID (XINT (XCAR (tail))); | |
| 7595 if (CHAR_CHARSET_P (c, charset)) | |
| 7596 break; | |
| 7597 } | |
| 7598 return (! NILP (tail)); | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7599 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7600 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7601 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7602 /* Return a list of coding systems that safely encode the text between |
| 88365 | 7603 START and END. If EXCLUDE is non-nil, it is a list of coding |
| 7604 systems not to check. The returned list doesn't contain any such | |
|
88889
4548f224c603
(Ffind_coding_systems_region_internal): Detect an
Kenichi Handa <handa@m17n.org>
parents:
88876
diff
changeset
|
7605 coding systems. In any case, if the text contains only ASCII or is |
| 88365 | 7606 unibyte, return t. */ |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7607 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7608 DEFUN ("find-coding-systems-region-internal", |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7609 Ffind_coding_systems_region_internal, |
| 88365 | 7610 Sfind_coding_systems_region_internal, 2, 3, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7611 doc: /* Internal use only. */) |
| 88365 | 7612 (start, end, exclude) |
| 7613 Lisp_Object start, end, exclude; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7614 { |
| 88365 | 7615 Lisp_Object coding_attrs_list, safe_codings; |
| 7616 EMACS_INT start_byte, end_byte; | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
7617 const unsigned char *p, *pbeg, *pend; |
| 88365 | 7618 int c; |
| 7619 Lisp_Object tail, elt; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7620 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7621 if (STRINGP (start)) |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7622 { |
| 88365 | 7623 if (!STRING_MULTIBYTE (start) |
| 89483 | 7624 || SCHARS (start) == SBYTES (start)) |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7625 return Qt; |
| 88365 | 7626 start_byte = 0; |
| 89483 | 7627 end_byte = SBYTES (start); |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7628 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7629 else |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7630 { |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7631 CHECK_NUMBER_COERCE_MARKER (start); |
|
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7632 CHECK_NUMBER_COERCE_MARKER (end); |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7633 if (XINT (start) < BEG || XINT (end) > Z || XINT (start) > XINT (end)) |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7634 args_out_of_range (start, end); |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7635 if (NILP (current_buffer->enable_multibyte_characters)) |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7636 return Qt; |
| 88365 | 7637 start_byte = CHAR_TO_BYTE (XINT (start)); |
| 7638 end_byte = CHAR_TO_BYTE (XINT (end)); | |
| 7639 if (XINT (end) - XINT (start) == end_byte - start_byte) | |
| 7640 return Qt; | |
| 7641 | |
|
89394
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
7642 if (XINT (start) < GPT && XINT (end) > GPT) |
| 88365 | 7643 { |
|
89394
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
7644 if ((GPT - XINT (start)) < (XINT (end) - GPT)) |
|
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
7645 move_gap_both (XINT (start), start_byte); |
| 88365 | 7646 else |
|
89394
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
7647 move_gap_both (XINT (end), end_byte); |
| 88365 | 7648 } |
| 7649 } | |
| 7650 | |
| 7651 coding_attrs_list = Qnil; | |
| 7652 for (tail = Vcoding_system_list; CONSP (tail); tail = XCDR (tail)) | |
| 7653 if (NILP (exclude) | |
| 7654 || NILP (Fmemq (XCAR (tail), exclude))) | |
| 7655 { | |
| 7656 Lisp_Object attrs; | |
| 7657 | |
| 7658 attrs = AREF (CODING_SYSTEM_SPEC (XCAR (tail)), 0); | |
| 7659 if (EQ (XCAR (tail), CODING_ATTR_BASE_NAME (attrs)) | |
| 7660 && ! EQ (CODING_ATTR_TYPE (attrs), Qundecided)) | |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7661 { |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7662 ASET (attrs, coding_attr_trans_tbl, |
|
89861
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
7663 get_translation_table (attrs, 1, NULL)); |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7664 coding_attrs_list = Fcons (attrs, coding_attrs_list); |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7665 } |
| 88365 | 7666 } |
| 7667 | |
| 7668 if (STRINGP (start)) | |
| 89483 | 7669 p = pbeg = SDATA (start); |
| 88365 | 7670 else |
| 7671 p = pbeg = BYTE_POS_ADDR (start_byte); | |
| 7672 pend = p + (end_byte - start_byte); | |
| 7673 | |
| 7674 while (p < pend && ASCII_BYTE_P (*p)) p++; | |
| 7675 while (p < pend && ASCII_BYTE_P (*(pend - 1))) pend--; | |
| 7676 | |
| 7677 while (p < pend) | |
| 7678 { | |
| 7679 if (ASCII_BYTE_P (*p)) | |
| 7680 p++; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7681 else |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7682 { |
| 88365 | 7683 c = STRING_CHAR_ADVANCE (p); |
| 7684 | |
| 7685 charset_map_loaded = 0; | |
| 7686 for (tail = coding_attrs_list; CONSP (tail);) | |
| 7687 { | |
| 7688 elt = XCAR (tail); | |
| 7689 if (NILP (elt)) | |
| 7690 tail = XCDR (tail); | |
| 7691 else if (char_encodable_p (c, elt)) | |
| 7692 tail = XCDR (tail); | |
| 7693 else if (CONSP (XCDR (tail))) | |
| 7694 { | |
| 7695 XSETCAR (tail, XCAR (XCDR (tail))); | |
| 7696 XSETCDR (tail, XCDR (XCDR (tail))); | |
| 7697 } | |
| 7698 else | |
| 7699 { | |
| 7700 XSETCAR (tail, Qnil); | |
| 7701 tail = XCDR (tail); | |
| 7702 } | |
| 7703 } | |
| 7704 if (charset_map_loaded) | |
| 7705 { | |
| 7706 EMACS_INT p_offset = p - pbeg, pend_offset = pend - pbeg; | |
| 7707 | |
| 7708 if (STRINGP (start)) | |
| 89483 | 7709 pbeg = SDATA (start); |
| 88365 | 7710 else |
| 7711 pbeg = BYTE_POS_ADDR (start_byte); | |
| 7712 p = pbeg + p_offset; | |
| 7713 pend = pbeg + pend_offset; | |
| 7714 } | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7715 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7716 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7717 |
|
89905
37e044cc35f6
(Ffind_coding_systems_region_internal): Include raw-text and
Kenichi Handa <handa@m17n.org>
parents:
89892
diff
changeset
|
7718 safe_codings = list2 (Qraw_text, Qno_conversion); |
| 88365 | 7719 for (tail = coding_attrs_list; CONSP (tail); tail = XCDR (tail)) |
| 7720 if (! NILP (XCAR (tail))) | |
| 7721 safe_codings = Fcons (CODING_ATTR_BASE_NAME (XCAR (tail)), safe_codings); | |
|
49539
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
7722 |
|
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
7723 return safe_codings; |
|
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
7724 } |
|
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
7725 |
|
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
7726 |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7727 DEFUN ("unencodable-char-position", Funencodable_char_position, |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7728 Sunencodable_char_position, 3, 5, 0, |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7729 doc: /* |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7730 Return position of first un-encodable character in a region. |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7731 START and END specfiy the region and CODING-SYSTEM specifies the |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7732 encoding to check. Return nil if CODING-SYSTEM does encode the region. |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7733 |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7734 If optional 4th argument COUNT is non-nil, it specifies at most how |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7735 many un-encodable characters to search. In this case, the value is a |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7736 list of positions. |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7737 |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7738 If optional 5th argument STRING is non-nil, it is a string to search |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7739 for un-encodable characters. In that case, START and END are indexes |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7740 to the string. */) |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7741 (start, end, coding_system, count, string) |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7742 Lisp_Object start, end, coding_system, count, string; |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7743 { |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7744 int n; |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7745 struct coding_system coding; |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7746 Lisp_Object attrs, charset_list, translation_table; |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7747 Lisp_Object positions; |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7748 int from, to; |
| 89483 | 7749 const unsigned char *p, *stop, *pend; |
| 7750 int ascii_compatible; | |
| 7751 | |
| 7752 setup_coding_system (Fcheck_coding_system (coding_system), &coding); | |
| 7753 attrs = CODING_ID_ATTRS (coding.id); | |
| 7754 if (EQ (CODING_ATTR_TYPE (attrs), Qraw_text)) | |
| 7755 return Qnil; | |
| 7756 ascii_compatible = ! NILP (CODING_ATTR_ASCII_COMPAT (attrs)); | |
| 7757 charset_list = CODING_ATTR_CHARSET_LIST (attrs); | |
|
89861
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
7758 translation_table = get_translation_table (attrs, 1, NULL); |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7759 |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7760 if (NILP (string)) |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7761 { |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7762 validate_region (&start, &end); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7763 from = XINT (start); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7764 to = XINT (end); |
| 89483 | 7765 if (NILP (current_buffer->enable_multibyte_characters) |
| 7766 || (ascii_compatible | |
| 7767 && (to - from) == (CHAR_TO_BYTE (to) - (CHAR_TO_BYTE (from))))) | |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7768 return Qnil; |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7769 p = CHAR_POS_ADDR (from); |
| 89483 | 7770 pend = CHAR_POS_ADDR (to); |
| 7771 if (from < GPT && to >= GPT) | |
| 7772 stop = GPT_ADDR; | |
|
48829
f6c59ca557c7
(Funencodable_char_position): Set pend correctly.
Kenichi Handa <handa@m17n.org>
parents:
48230
diff
changeset
|
7773 else |
| 89483 | 7774 stop = pend; |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7775 } |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7776 else |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7777 { |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7778 CHECK_STRING (string); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7779 CHECK_NATNUM (start); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7780 CHECK_NATNUM (end); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7781 from = XINT (start); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7782 to = XINT (end); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7783 if (from > to |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7784 || to > SCHARS (string)) |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7785 args_out_of_range_3 (string, start, end); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7786 if (! STRING_MULTIBYTE (string)) |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7787 return Qnil; |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7788 p = SDATA (string) + string_char_to_byte (string, from); |
| 89483 | 7789 stop = pend = SDATA (string) + string_char_to_byte (string, to); |
| 7790 if (ascii_compatible && (to - from) == (pend - p)) | |
| 7791 return Qnil; | |
| 7792 } | |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7793 |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7794 if (NILP (count)) |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7795 n = 1; |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7796 else |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7797 { |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7798 CHECK_NATNUM (count); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7799 n = XINT (count); |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7800 } |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7801 |
| 89483 | 7802 positions = Qnil; |
| 7803 while (1) | |
| 7804 { | |
| 7805 int c; | |
| 7806 | |
| 7807 if (ascii_compatible) | |
| 7808 while (p < stop && ASCII_BYTE_P (*p)) | |
| 7809 p++, from++; | |
| 7810 if (p >= stop) | |
| 7811 { | |
| 7812 if (p >= pend) | |
| 7813 break; | |
| 7814 stop = pend; | |
| 7815 p = GAP_END_ADDR; | |
| 7816 } | |
| 7817 | |
| 7818 c = STRING_CHAR_ADVANCE (p); | |
| 7819 if (! (ASCII_CHAR_P (c) && ascii_compatible) | |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7820 && ! char_charset (translate_char (translation_table, c), |
|
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7821 charset_list, NULL)) |
| 89483 | 7822 { |
| 7823 positions = Fcons (make_number (from), positions); | |
| 7824 n--; | |
| 7825 if (n == 0) | |
| 7826 break; | |
| 7827 } | |
| 7828 | |
| 7829 from++; | |
| 7830 } | |
| 7831 | |
| 7832 return (NILP (count) ? Fcar (positions) : Fnreverse (positions)); | |
| 7833 } | |
| 7834 | |
| 7835 | |
| 88365 | 7836 DEFUN ("check-coding-systems-region", Fcheck_coding_systems_region, |
| 7837 Scheck_coding_systems_region, 3, 3, 0, | |
| 7838 doc: /* Check if the region is encodable by coding systems. | |
| 7839 | |
| 7840 START and END are buffer positions specifying the region. | |
| 7841 CODING-SYSTEM-LIST is a list of coding systems to check. | |
| 7842 | |
| 7843 The value is an alist ((CODING-SYSTEM POS0 POS1 ...) ...), where | |
| 7844 CODING-SYSTEM is a member of CODING-SYSTEM-LIst and can't encode the | |
| 7845 whole region, POS0, POS1, ... are buffer positions where non-encodable | |
| 7846 characters are found. | |
| 7847 | |
| 7848 If all coding systems in CODING-SYSTEM-LIST can encode the region, the | |
| 7849 value is nil. | |
| 7850 | |
| 7851 START may be a string. In that case, check if the string is | |
| 7852 encodable, and the value contains indices to the string instead of | |
| 7853 buffer positions. END is ignored. */) | |
| 7854 (start, end, coding_system_list) | |
| 7855 Lisp_Object start, end, coding_system_list; | |
| 7856 { | |
| 7857 Lisp_Object list; | |
| 7858 EMACS_INT start_byte, end_byte; | |
| 7859 int pos; | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
7860 const unsigned char *p, *pbeg, *pend; |
| 88365 | 7861 int c; |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7862 Lisp_Object tail, elt, attrs; |
| 88365 | 7863 |
| 7864 if (STRINGP (start)) | |
| 7865 { | |
| 7866 if (!STRING_MULTIBYTE (start) | |
| 89483 | 7867 && SCHARS (start) != SBYTES (start)) |
| 88365 | 7868 return Qnil; |
| 7869 start_byte = 0; | |
| 89483 | 7870 end_byte = SBYTES (start); |
| 88365 | 7871 pos = 0; |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
7872 } |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7873 else |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7874 { |
| 88365 | 7875 CHECK_NUMBER_COERCE_MARKER (start); |
| 7876 CHECK_NUMBER_COERCE_MARKER (end); | |
| 7877 if (XINT (start) < BEG || XINT (end) > Z || XINT (start) > XINT (end)) | |
| 7878 args_out_of_range (start, end); | |
| 7879 if (NILP (current_buffer->enable_multibyte_characters)) | |
| 7880 return Qnil; | |
| 7881 start_byte = CHAR_TO_BYTE (XINT (start)); | |
| 7882 end_byte = CHAR_TO_BYTE (XINT (end)); | |
| 7883 if (XINT (end) - XINT (start) == end_byte - start_byte) | |
| 7884 return Qt; | |
| 7885 | |
|
89394
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
7886 if (XINT (start) < GPT && XINT (end) > GPT) |
| 88365 | 7887 { |
|
89394
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
7888 if ((GPT - XINT (start)) < (XINT (end) - GPT)) |
|
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
7889 move_gap_both (XINT (start), start_byte); |
| 88365 | 7890 else |
|
89394
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
7891 move_gap_both (XINT (end), end_byte); |
| 88365 | 7892 } |
|
89394
6ffca50f25b9
(Fcheck_coding_systems_region): Fix type errors.
Dave Love <fx@gnu.org>
parents:
89373
diff
changeset
|
7893 pos = XINT (start); |
| 88365 | 7894 } |
| 7895 | |
| 7896 list = Qnil; | |
| 7897 for (tail = coding_system_list; CONSP (tail); tail = XCDR (tail)) | |
| 7898 { | |
| 7899 elt = XCAR (tail); | |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7900 attrs = AREF (CODING_SYSTEM_SPEC (elt), 0); |
|
89861
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
7901 ASET (attrs, coding_attr_trans_tbl, |
|
7160ded23e55
(get_translation_table): Allow max_lookup to be NULL.
Kenichi Handa <handa@m17n.org>
parents:
89859
diff
changeset
|
7902 get_translation_table (attrs, 1, NULL)); |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
7903 list = Fcons (Fcons (elt, Fcons (attrs, Qnil)), list); |
| 88365 | 7904 } |
| 7905 | |
| 7906 if (STRINGP (start)) | |
| 89483 | 7907 p = pbeg = SDATA (start); |
| 88365 | 7908 else |
| 7909 p = pbeg = BYTE_POS_ADDR (start_byte); | |
| 7910 pend = p + (end_byte - start_byte); | |
| 7911 | |
| 7912 while (p < pend && ASCII_BYTE_P (*p)) p++, pos++; | |
| 7913 while (p < pend && ASCII_BYTE_P (*(pend - 1))) pend--; | |
| 7914 | |
| 7915 while (p < pend) | |
| 7916 { | |
| 7917 if (ASCII_BYTE_P (*p)) | |
| 7918 p++; | |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7919 else |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7920 { |
| 88365 | 7921 c = STRING_CHAR_ADVANCE (p); |
| 7922 | |
| 7923 charset_map_loaded = 0; | |
| 7924 for (tail = list; CONSP (tail); tail = XCDR (tail)) | |
| 7925 { | |
| 7926 elt = XCDR (XCAR (tail)); | |
| 7927 if (! char_encodable_p (c, XCAR (elt))) | |
| 7928 XSETCDR (elt, Fcons (make_number (pos), XCDR (elt))); | |
| 7929 } | |
| 7930 if (charset_map_loaded) | |
| 7931 { | |
| 7932 EMACS_INT p_offset = p - pbeg, pend_offset = pend - pbeg; | |
| 7933 | |
| 7934 if (STRINGP (start)) | |
| 89483 | 7935 pbeg = SDATA (start); |
| 88365 | 7936 else |
| 7937 pbeg = BYTE_POS_ADDR (start_byte); | |
| 7938 p = pbeg + p_offset; | |
| 7939 pend = pbeg + pend_offset; | |
| 7940 } | |
| 7941 } | |
| 7942 pos++; | |
| 7943 } | |
| 7944 | |
| 7945 tail = list; | |
| 7946 list = Qnil; | |
| 7947 for (; CONSP (tail); tail = XCDR (tail)) | |
| 7948 { | |
| 7949 elt = XCAR (tail); | |
| 7950 if (CONSP (XCDR (XCDR (elt)))) | |
| 7951 list = Fcons (Fcons (XCAR (elt), Fnreverse (XCDR (XCDR (elt)))), | |
| 7952 list); | |
| 7953 } | |
| 7954 | |
| 7955 return list; | |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7956 } |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7957 |
|
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
7958 |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
7959 Lisp_Object |
| 88365 | 7960 code_convert_region (start, end, coding_system, dst_object, encodep, norecord) |
| 7961 Lisp_Object start, end, coding_system, dst_object; | |
| 7962 int encodep, norecord; | |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
7963 { |
|
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
7964 struct coding_system coding; |
| 88365 | 7965 EMACS_INT from, from_byte, to, to_byte; |
| 7966 Lisp_Object src_object; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7967 |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7968 CHECK_NUMBER_COERCE_MARKER (start); |
|
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7969 CHECK_NUMBER_COERCE_MARKER (end); |
| 88365 | 7970 if (NILP (coding_system)) |
| 7971 coding_system = Qno_conversion; | |
| 7972 else | |
| 7973 CHECK_CODING_SYSTEM (coding_system); | |
| 7974 src_object = Fcurrent_buffer (); | |
| 7975 if (NILP (dst_object)) | |
| 7976 dst_object = src_object; | |
| 7977 else if (! EQ (dst_object, Qt)) | |
| 7978 CHECK_BUFFER (dst_object); | |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
7979 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7980 validate_region (&start, &end); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7981 from = XFASTINT (start); |
| 88365 | 7982 from_byte = CHAR_TO_BYTE (from); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7983 to = XFASTINT (end); |
| 88365 | 7984 to_byte = CHAR_TO_BYTE (to); |
| 7985 | |
| 7986 setup_coding_system (coding_system, &coding); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7987 coding.mode |= CODING_MODE_LAST_BLOCK; |
| 88365 | 7988 |
| 7989 if (encodep) | |
| 7990 encode_coding_object (&coding, src_object, from, from_byte, to, to_byte, | |
| 7991 dst_object); | |
| 7992 else | |
| 7993 decode_coding_object (&coding, src_object, from, from_byte, to, to_byte, | |
| 7994 dst_object); | |
| 7995 if (! norecord) | |
| 7996 Vlast_coding_system_used = CODING_ID_NAME (coding.id); | |
| 7997 | |
| 7998 return (BUFFERP (dst_object) | |
| 7999 ? make_number (coding.produced_char) | |
| 8000 : coding.dst_object); | |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
8001 } |
|
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
8002 |
|
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
8003 |
|
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
8004 DEFUN ("decode-coding-region", Fdecode_coding_region, Sdecode_coding_region, |
| 88365 | 8005 3, 4, "r\nzCoding system: ", |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8006 doc: /* Decode the current region from the specified coding system. |
| 88365 | 8007 When called from a program, takes four arguments: |
| 8008 START, END, CODING-SYSTEM, and DESTINATION. | |
| 8009 START and END are buffer positions. | |
| 8010 | |
| 8011 Optional 4th arguments DESTINATION specifies where the decoded text goes. | |
|
91083
ff87badce376
(Fdecode_coding_region): Fix typo in docstring.
Kenichi Handa <handa@m17n.org>
parents:
91056
diff
changeset
|
8012 If nil, the region between START and END is replaced by the decoded text. |
| 88365 | 8013 If buffer, the decoded text is inserted in the buffer. |
| 8014 If t, the decoded text is returned. | |
| 8015 | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8016 This function sets `last-coding-system-used' to the precise coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8017 used (which may be different from CODING-SYSTEM if CODING-SYSTEM is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8018 not fully specified.) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8019 It returns the length of the decoded text. */) |
| 88365 | 8020 (start, end, coding_system, destination) |
| 8021 Lisp_Object start, end, coding_system, destination; | |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
8022 { |
| 88365 | 8023 return code_convert_region (start, end, coding_system, destination, 0, 0); |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
8024 } |
|
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
8025 |
|
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
8026 DEFUN ("encode-coding-region", Fencode_coding_region, Sencode_coding_region, |
| 88365 | 8027 3, 4, "r\nzCoding system: ", |
| 8028 doc: /* Encode the current region by specified coding system. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8029 When called from a program, takes three arguments: |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8030 START, END, and CODING-SYSTEM. START and END are buffer positions. |
| 88365 | 8031 |
| 8032 Optional 4th arguments DESTINATION specifies where the encoded text goes. | |
| 8033 If nil, the region between START and END is replace by the encoded text. | |
| 8034 If buffer, the encoded text is inserted in the buffer. | |
| 8035 If t, the encoded text is returned. | |
| 8036 | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8037 This function sets `last-coding-system-used' to the precise coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8038 used (which may be different from CODING-SYSTEM if CODING-SYSTEM is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8039 not fully specified.) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8040 It returns the length of the encoded text. */) |
| 88365 | 8041 (start, end, coding_system, destination) |
| 8042 Lisp_Object start, end, coding_system, destination; | |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
8043 { |
| 88365 | 8044 return code_convert_region (start, end, coding_system, destination, 1, 0); |
| 17052 | 8045 } |
| 8046 | |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
8047 Lisp_Object |
| 88365 | 8048 code_convert_string (string, coding_system, dst_object, |
| 8049 encodep, nocopy, norecord) | |
| 8050 Lisp_Object string, coding_system, dst_object; | |
| 8051 int encodep, nocopy, norecord; | |
| 17052 | 8052 { |
| 8053 struct coding_system coding; | |
| 88365 | 8054 EMACS_INT chars, bytes; |
| 17052 | 8055 |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
8056 CHECK_STRING (string); |
| 88365 | 8057 if (NILP (coding_system)) |
| 8058 { | |
| 8059 if (! norecord) | |
| 8060 Vlast_coding_system_used = Qno_conversion; | |
| 8061 if (NILP (dst_object)) | |
| 8062 return (nocopy ? Fcopy_sequence (string) : string); | |
| 8063 } | |
| 17052 | 8064 |
|
70520
b6740a317343
(setup_coding_system): For invalid coding-system, set
Kenichi Handa <handa@m17n.org>
parents:
69995
diff
changeset
|
8065 if (NILP (coding_system)) |
| 88365 | 8066 coding_system = Qno_conversion; |
| 8067 else | |
| 8068 CHECK_CODING_SYSTEM (coding_system); | |
| 8069 if (NILP (dst_object)) | |
| 8070 dst_object = Qt; | |
| 8071 else if (! EQ (dst_object, Qt)) | |
| 8072 CHECK_BUFFER (dst_object); | |
| 8073 | |
| 8074 setup_coding_system (coding_system, &coding); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8075 coding.mode |= CODING_MODE_LAST_BLOCK; |
| 89483 | 8076 chars = SCHARS (string); |
| 8077 bytes = SBYTES (string); | |
| 88365 | 8078 if (encodep) |
| 8079 encode_coding_object (&coding, string, 0, 0, chars, bytes, dst_object); | |
| 8080 else | |
| 8081 decode_coding_object (&coding, string, 0, 0, chars, bytes, dst_object); | |
| 8082 if (! norecord) | |
| 8083 Vlast_coding_system_used = CODING_ID_NAME (coding.id); | |
| 8084 | |
| 8085 return (BUFFERP (dst_object) | |
| 8086 ? make_number (coding.produced_char) | |
| 8087 : coding.dst_object); | |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
8088 } |
|
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
8089 |
|
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
8090 |
|
22341
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
8091 /* Encode or decode STRING according to CODING_SYSTEM. |
| 26847 | 8092 Do not set Vlast_coding_system_used. |
| 8093 | |
| 8094 This function is called only from macros DECODE_FILE and | |
| 8095 ENCODE_FILE, thus we ignore character composition. */ | |
|
22341
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
8096 |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
8097 Lisp_Object |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
8098 code_convert_string_norecord (string, coding_system, encodep) |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
8099 Lisp_Object string, coding_system; |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
8100 int encodep; |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
8101 { |
|
88430
6418a272b97e
* coding.c: Delete unused variables.
Kenichi Handa <handa@m17n.org>
parents:
88365
diff
changeset
|
8102 return code_convert_string (string, coding_system, Qt, encodep, 0, 1); |
|
22341
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
8103 } |
| 88365 | 8104 |
| 8105 | |
| 8106 DEFUN ("decode-coding-string", Fdecode_coding_string, Sdecode_coding_string, | |
| 8107 2, 4, 0, | |
| 8108 doc: /* Decode STRING which is encoded in CODING-SYSTEM, and return the result. | |
| 8109 | |
| 8110 Optional third arg NOCOPY non-nil means it is OK to return STRING itself | |
| 8111 if the decoding operation is trivial. | |
| 8112 | |
| 8113 Optional fourth arg BUFFER non-nil meant that the decoded text is | |
|
88845
64b8f6168269
(Fset_coding_system_priority): Allow null arg list.
Dave Love <fx@gnu.org>
parents:
88771
diff
changeset
|
8114 inserted in BUFFER instead of returned as a string. In this case, |
| 88365 | 8115 the return value is BUFFER. |
| 8116 | |
| 8117 This function sets `last-coding-system-used' to the precise coding system | |
| 8118 used (which may be different from CODING-SYSTEM if CODING-SYSTEM is | |
| 8119 not fully specified. */) | |
| 8120 (string, coding_system, nocopy, buffer) | |
| 8121 Lisp_Object string, coding_system, nocopy, buffer; | |
| 8122 { | |
| 8123 return code_convert_string (string, coding_system, buffer, | |
| 8124 0, ! NILP (nocopy), 0); | |
| 8125 } | |
| 8126 | |
| 8127 DEFUN ("encode-coding-string", Fencode_coding_string, Sencode_coding_string, | |
| 8128 2, 4, 0, | |
| 8129 doc: /* Encode STRING to CODING-SYSTEM, and return the result. | |
| 8130 | |
| 8131 Optional third arg NOCOPY non-nil means it is OK to return STRING | |
| 8132 itself if the encoding operation is trivial. | |
| 8133 | |
| 8134 Optional fourth arg BUFFER non-nil meant that the encoded text is | |
|
88845
64b8f6168269
(Fset_coding_system_priority): Allow null arg list.
Dave Love <fx@gnu.org>
parents:
88771
diff
changeset
|
8135 inserted in BUFFER instead of returned as a string. In this case, |
| 88365 | 8136 the return value is BUFFER. |
| 8137 | |
| 8138 This function sets `last-coding-system-used' to the precise coding system | |
| 8139 used (which may be different from CODING-SYSTEM if CODING-SYSTEM is | |
| 8140 not fully specified.) */) | |
| 8141 (string, coding_system, nocopy, buffer) | |
| 8142 Lisp_Object string, coding_system, nocopy, buffer; | |
| 8143 { | |
| 8144 return code_convert_string (string, coding_system, buffer, | |
| 88856 | 8145 1, ! NILP (nocopy), 1); |
| 88365 | 8146 } |
| 8147 | |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
8148 |
| 17052 | 8149 DEFUN ("decode-sjis-char", Fdecode_sjis_char, Sdecode_sjis_char, 1, 1, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8150 doc: /* Decode a Japanese character which has CODE in shift_jis encoding. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8151 Return the corresponding character. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8152 (code) |
| 17052 | 8153 Lisp_Object code; |
| 8154 { | |
| 88365 | 8155 Lisp_Object spec, attrs, val; |
| 8156 struct charset *charset_roman, *charset_kanji, *charset_kana, *charset; | |
| 8157 int c; | |
| 8158 | |
| 8159 CHECK_NATNUM (code); | |
| 8160 c = XFASTINT (code); | |
| 8161 CHECK_CODING_SYSTEM_GET_SPEC (Vsjis_coding_system, spec); | |
| 8162 attrs = AREF (spec, 0); | |
| 8163 | |
| 8164 if (ASCII_BYTE_P (c) | |
| 8165 && ! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 8166 return code; | |
| 8167 | |
| 8168 val = CODING_ATTR_CHARSET_LIST (attrs); | |
| 8169 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
|
88497
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
8170 charset_kana = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); |
|
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
8171 charset_kanji = CHARSET_FROM_ID (XINT (XCAR (val))); |
| 88365 | 8172 |
| 8173 if (c <= 0x7F) | |
| 8174 charset = charset_roman; | |
| 8175 else if (c >= 0xA0 && c < 0xDF) | |
| 8176 { | |
| 8177 charset = charset_kana; | |
| 8178 c -= 0x80; | |
|
24065
7e291dea6141
(Fdecode_sjis_char): Decode Japanese Katakana character
Kenichi Handa <handa@m17n.org>
parents:
24056
diff
changeset
|
8179 } |
|
7e291dea6141
(Fdecode_sjis_char): Decode Japanese Katakana character
Kenichi Handa <handa@m17n.org>
parents:
24056
diff
changeset
|
8180 else |
|
7e291dea6141
(Fdecode_sjis_char): Decode Japanese Katakana character
Kenichi Handa <handa@m17n.org>
parents:
24056
diff
changeset
|
8181 { |
|
88497
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
8182 int s1 = c >> 8, s2 = c & 0xFF; |
| 88365 | 8183 |
| 8184 if (s1 < 0x81 || (s1 > 0x9F && s1 < 0xE0) || s1 > 0xEF | |
| 8185 || s2 < 0x40 || s2 == 0x7F || s2 > 0xFC) | |
| 8186 error ("Invalid code: %d", code); | |
| 8187 SJIS_TO_JIS (c); | |
| 8188 charset = charset_kanji; | |
| 8189 } | |
| 8190 c = DECODE_CHAR (charset, c); | |
| 8191 if (c < 0) | |
| 8192 error ("Invalid code: %d", code); | |
| 8193 return make_number (c); | |
| 17052 | 8194 } |
| 8195 | |
| 8196 | |
| 8197 DEFUN ("encode-sjis-char", Fencode_sjis_char, Sencode_sjis_char, 1, 1, 0, | |
|
73949
0d1207b43a5b
(Fencode_sjis_char, Fencode_big5_char): Improve argument/docstring consistency.
Juanma Barranquero <lekktu@gmail.com>
parents:
72552
diff
changeset
|
8198 doc: /* Encode a Japanese character CH to shift_jis encoding. |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8199 Return the corresponding code in SJIS. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8200 (ch) |
| 88365 | 8201 Lisp_Object ch; |
| 17052 | 8202 { |
| 88365 | 8203 Lisp_Object spec, attrs, charset_list; |
| 8204 int c; | |
| 8205 struct charset *charset; | |
| 8206 unsigned code; | |
| 8207 | |
| 8208 CHECK_CHARACTER (ch); | |
| 8209 c = XFASTINT (ch); | |
| 8210 CHECK_CODING_SYSTEM_GET_SPEC (Vsjis_coding_system, spec); | |
| 8211 attrs = AREF (spec, 0); | |
| 8212 | |
| 8213 if (ASCII_CHAR_P (c) | |
| 8214 && ! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 8215 return ch; | |
| 8216 | |
| 8217 charset_list = CODING_ATTR_CHARSET_LIST (attrs); | |
| 8218 charset = char_charset (c, charset_list, &code); | |
| 8219 if (code == CHARSET_INVALID_CODE (charset)) | |
| 8220 error ("Can't encode by shift_jis encoding: %d", c); | |
| 8221 JIS_TO_SJIS (code); | |
| 8222 | |
| 8223 return make_number (code); | |
| 17052 | 8224 } |
| 8225 | |
| 8226 DEFUN ("decode-big5-char", Fdecode_big5_char, Sdecode_big5_char, 1, 1, 0, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8227 doc: /* Decode a Big5 character which has CODE in BIG5 coding system. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8228 Return the corresponding character. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8229 (code) |
| 17052 | 8230 Lisp_Object code; |
| 8231 { | |
| 88365 | 8232 Lisp_Object spec, attrs, val; |
| 8233 struct charset *charset_roman, *charset_big5, *charset; | |
| 8234 int c; | |
| 8235 | |
| 8236 CHECK_NATNUM (code); | |
| 8237 c = XFASTINT (code); | |
| 8238 CHECK_CODING_SYSTEM_GET_SPEC (Vbig5_coding_system, spec); | |
| 8239 attrs = AREF (spec, 0); | |
| 8240 | |
| 8241 if (ASCII_BYTE_P (c) | |
| 8242 && ! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 8243 return code; | |
| 8244 | |
| 8245 val = CODING_ATTR_CHARSET_LIST (attrs); | |
| 8246 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
| 8247 charset_big5 = CHARSET_FROM_ID (XINT (XCAR (val))); | |
| 8248 | |
| 8249 if (c <= 0x7F) | |
| 8250 charset = charset_roman; | |
|
24324
2eec590faf26
(Fdecode_sjis_char, Fencode_sjis_char): Hanlde
Kenichi Handa <handa@m17n.org>
parents:
24316
diff
changeset
|
8251 else |
|
2eec590faf26
(Fdecode_sjis_char, Fencode_sjis_char): Hanlde
Kenichi Handa <handa@m17n.org>
parents:
24316
diff
changeset
|
8252 { |
| 88365 | 8253 int b1 = c >> 8, b2 = c & 0x7F; |
| 8254 if (b1 < 0xA1 || b1 > 0xFE | |
| 8255 || b2 < 0x40 || (b2 > 0x7E && b2 < 0xA1) || b2 > 0xFE) | |
| 8256 error ("Invalid code: %d", code); | |
| 8257 charset = charset_big5; | |
| 8258 } | |
| 8259 c = DECODE_CHAR (charset, (unsigned )c); | |
| 8260 if (c < 0) | |
| 8261 error ("Invalid code: %d", code); | |
| 8262 return make_number (c); | |
| 17052 | 8263 } |
| 8264 | |
| 8265 DEFUN ("encode-big5-char", Fencode_big5_char, Sencode_big5_char, 1, 1, 0, | |
|
73949
0d1207b43a5b
(Fencode_sjis_char, Fencode_big5_char): Improve argument/docstring consistency.
Juanma Barranquero <lekktu@gmail.com>
parents:
72552
diff
changeset
|
8266 doc: /* Encode the Big5 character CH to BIG5 coding system. |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8267 Return the corresponding character code in Big5. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8268 (ch) |
| 17052 | 8269 Lisp_Object ch; |
| 8270 { | |
| 88365 | 8271 Lisp_Object spec, attrs, charset_list; |
| 8272 struct charset *charset; | |
| 8273 int c; | |
| 8274 unsigned code; | |
| 8275 | |
| 8276 CHECK_CHARACTER (ch); | |
| 8277 c = XFASTINT (ch); | |
| 8278 CHECK_CODING_SYSTEM_GET_SPEC (Vbig5_coding_system, spec); | |
| 8279 attrs = AREF (spec, 0); | |
| 8280 if (ASCII_CHAR_P (c) | |
| 8281 && ! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 8282 return ch; | |
| 8283 | |
| 8284 charset_list = CODING_ATTR_CHARSET_LIST (attrs); | |
| 8285 charset = char_charset (c, charset_list, &code); | |
| 8286 if (code == CHARSET_INVALID_CODE (charset)) | |
| 8287 error ("Can't encode by Big5 encoding: %d", c); | |
| 8288 | |
| 8289 return make_number (code); | |
| 17052 | 8290 } |
| 88365 | 8291 |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
8292 |
|
48182
9474e269efd1
Reformat some DEFUNs so that etags works.
Dave Love <fx@gnu.org>
parents:
48125
diff
changeset
|
8293 DEFUN ("set-terminal-coding-system-internal", Fset_terminal_coding_system_internal, |
|
83298
ed09a89e2b25
Fix UTF-8 tty input when first frame is an X frame. Steps towards multiple tty locale support.
Karoly Lorentey <lorentey@elte.hu>
parents:
83292
diff
changeset
|
8294 Sset_terminal_coding_system_internal, 1, 2, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8295 doc: /* Internal use only. */) |
|
83431
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8296 (coding_system, terminal) |
| 17052 | 8297 Lisp_Object coding_system; |
|
83431
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8298 Lisp_Object terminal; |
| 17052 | 8299 { |
|
83431
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8300 struct coding_system *terminal_coding = TERMINAL_TERMINAL_CODING (get_terminal (terminal, 1)); |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
8301 CHECK_SYMBOL (coding_system); |
|
83127
5182815e0ee1
Make terminal_coding and keyboard_coding display-local.
Karoly Lorentey <lorentey@elte.hu>
parents:
54320
diff
changeset
|
8302 setup_coding_system (Fcheck_coding_system (coding_system), terminal_coding); |
|
20150
402b6e5f4b58
(encode_designation_at_bol): Fix bug of finding graphic
Kenichi Handa <handa@m17n.org>
parents:
20105
diff
changeset
|
8303 /* We had better not send unsafe characters to terminal. */ |
| 91041 | 8304 terminal_coding->mode |= CODING_MODE_SAFE_ENCODING; |
| 88365 | 8305 /* Characer composition should be disabled. */ |
| 91041 | 8306 terminal_coding->common_flags &= ~CODING_ANNOTATE_COMPOSITION_MASK; |
|
83127
5182815e0ee1
Make terminal_coding and keyboard_coding display-local.
Karoly Lorentey <lorentey@elte.hu>
parents:
54320
diff
changeset
|
8307 terminal_coding->src_multibyte = 1; |
|
5182815e0ee1
Make terminal_coding and keyboard_coding display-local.
Karoly Lorentey <lorentey@elte.hu>
parents:
54320
diff
changeset
|
8308 terminal_coding->dst_multibyte = 0; |
| 17052 | 8309 return Qnil; |
| 8310 } | |
| 8311 | |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8312 DEFUN ("set-safe-terminal-coding-system-internal", |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8313 Fset_safe_terminal_coding_system_internal, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8314 Sset_safe_terminal_coding_system_internal, 1, 1, 0, |
| 41006 | 8315 doc: /* Internal use only. */) |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8316 (coding_system) |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8317 Lisp_Object coding_system; |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8318 { |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
8319 CHECK_SYMBOL (coding_system); |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8320 setup_coding_system (Fcheck_coding_system (coding_system), |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8321 &safe_terminal_coding); |
| 88365 | 8322 /* Characer composition should be disabled. */ |
| 8323 safe_terminal_coding.common_flags &= ~CODING_ANNOTATE_COMPOSITION_MASK; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
8324 safe_terminal_coding.src_multibyte = 1; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
8325 safe_terminal_coding.dst_multibyte = 0; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8326 return Qnil; |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8327 } |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8328 |
|
48182
9474e269efd1
Reformat some DEFUNs so that etags works.
Dave Love <fx@gnu.org>
parents:
48125
diff
changeset
|
8329 DEFUN ("terminal-coding-system", Fterminal_coding_system, |
|
83298
ed09a89e2b25
Fix UTF-8 tty input when first frame is an X frame. Steps towards multiple tty locale support.
Karoly Lorentey <lorentey@elte.hu>
parents:
83292
diff
changeset
|
8330 Sterminal_coding_system, 0, 1, 0, |
|
83431
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8331 doc: /* Return coding system specified for terminal output on the given terminal. |
|
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8332 TERMINAL may be a terminal id, a frame, or nil for the selected |
|
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8333 frame's terminal device. */) |
|
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8334 (terminal) |
|
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8335 Lisp_Object terminal; |
| 17052 | 8336 { |
| 91046 | 8337 struct coding_system *terminal_coding |
| 8338 = TERMINAL_TERMINAL_CODING (get_terminal (terminal, 1)); | |
| 8339 Lisp_Object coding_system = CODING_ID_NAME (terminal_coding->id); | |
| 8340 | |
|
90011
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
8341 /* For backward compatibility, return nil if it is `undecided'. */ |
|
90359
041f75914d0c
(produce_composition): Compare charbuf[i] instead of
Kenichi Handa <handa@m17n.org>
parents:
90354
diff
changeset
|
8342 return (! EQ (coding_system, Qundecided) ? coding_system : Qnil); |
| 17052 | 8343 } |
| 8344 | |
|
48182
9474e269efd1
Reformat some DEFUNs so that etags works.
Dave Love <fx@gnu.org>
parents:
48125
diff
changeset
|
8345 DEFUN ("set-keyboard-coding-system-internal", Fset_keyboard_coding_system_internal, |
|
83298
ed09a89e2b25
Fix UTF-8 tty input when first frame is an X frame. Steps towards multiple tty locale support.
Karoly Lorentey <lorentey@elte.hu>
parents:
83292
diff
changeset
|
8346 Sset_keyboard_coding_system_internal, 1, 2, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8347 doc: /* Internal use only. */) |
|
83431
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8348 (coding_system, terminal) |
| 17052 | 8349 Lisp_Object coding_system; |
|
83431
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8350 Lisp_Object terminal; |
| 17052 | 8351 { |
|
83431
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8352 struct terminal *t = get_terminal (terminal, 1); |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
8353 CHECK_SYMBOL (coding_system); |
|
83127
5182815e0ee1
Make terminal_coding and keyboard_coding display-local.
Karoly Lorentey <lorentey@elte.hu>
parents:
54320
diff
changeset
|
8354 setup_coding_system (Fcheck_coding_system (coding_system), |
| 91041 | 8355 TERMINAL_KEYBOARD_CODING (t)); |
| 88365 | 8356 /* Characer composition should be disabled. */ |
| 91041 | 8357 TERMINAL_KEYBOARD_CODING (t)->common_flags |
| 8358 &= ~CODING_ANNOTATE_COMPOSITION_MASK; | |
| 17052 | 8359 return Qnil; |
| 8360 } | |
| 8361 | |
| 8362 DEFUN ("keyboard-coding-system", | |
| 91046 | 8363 Fkeyboard_coding_system, Skeyboard_coding_system, 0, 1, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8364 doc: /* Return coding system specified for decoding keyboard input. */) |
|
83431
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8365 (terminal) |
|
76396de7f50a
Rename `struct device' to `struct terminal'. Rename some terminal-related functions similarly.
Karoly Lorentey <lorentey@elte.hu>
parents:
83423
diff
changeset
|
8366 Lisp_Object terminal; |
| 17052 | 8367 { |
| 91046 | 8368 return CODING_ID_NAME (TERMINAL_KEYBOARD_CODING |
| 8369 (get_terminal (terminal, 1))->id); | |
| 17052 | 8370 } |
| 8371 | |
| 8372 | |
|
18536
69c0e220b626
(Vstandard_character_unification_table_for_decode):
Kenichi Handa <handa@m17n.org>
parents:
18523
diff
changeset
|
8373 DEFUN ("find-operation-coding-system", Ffind_operation_coding_system, |
|
69c0e220b626
(Vstandard_character_unification_table_for_decode):
Kenichi Handa <handa@m17n.org>
parents:
18523
diff
changeset
|
8374 Sfind_operation_coding_system, 1, MANY, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8375 doc: /* Choose a coding system for an operation based on the target name. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8376 The value names a pair of coding systems: (DECODING-SYSTEM . ENCODING-SYSTEM). |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8377 DECODING-SYSTEM is the coding system to use for decoding |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8378 \(in case OPERATION does decoding), and ENCODING-SYSTEM is the coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8379 for encoding (in case OPERATION does encoding). |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8380 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8381 The first argument OPERATION specifies an I/O primitive: |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8382 For file I/O, `insert-file-contents' or `write-region'. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8383 For process I/O, `call-process', `call-process-region', or `start-process'. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8384 For network I/O, `open-network-stream'. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8385 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8386 The remaining arguments should be the same arguments that were passed |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8387 to the primitive. Depending on which primitive, one of those arguments |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8388 is selected as the TARGET. For example, if OPERATION does file I/O, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8389 whichever argument specifies the file name is TARGET. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8390 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8391 TARGET has a meaning which depends on OPERATION: |
|
70948
7ea8b1c11d80
(Ffind_operation_coding_system): Allow (FILENAME . BUFFER) in TARGET.
Kenichi Handa <handa@m17n.org>
parents:
70704
diff
changeset
|
8392 For file I/O, TARGET is a file name (except for the special case below). |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8393 For process I/O, TARGET is a process name. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8394 For network I/O, TARGET is a service name or a port number |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8395 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8396 This function looks up what specified for TARGET in, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8397 `file-coding-system-alist', `process-coding-system-alist', |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8398 or `network-coding-system-alist' depending on OPERATION. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8399 They may specify a coding system, a cons of coding systems, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8400 or a function symbol to call. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8401 In the last case, we call the function with one argument, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8402 which is a list of all the arguments given to this function. |
|
81611
ae42ad5f89e6
(Ffind_operation_coding_system): Docstring improved.
Kenichi Handa <handa@m17n.org>
parents:
75348
diff
changeset
|
8403 If the function can't decide a coding system, it can return |
|
ae42ad5f89e6
(Ffind_operation_coding_system): Docstring improved.
Kenichi Handa <handa@m17n.org>
parents:
75348
diff
changeset
|
8404 `undecided' so that the normal code-detection is performed. |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8405 |
|
70948
7ea8b1c11d80
(Ffind_operation_coding_system): Allow (FILENAME . BUFFER) in TARGET.
Kenichi Handa <handa@m17n.org>
parents:
70704
diff
changeset
|
8406 If OPERATION is `insert-file-contents', the argument corresponding to |
|
7ea8b1c11d80
(Ffind_operation_coding_system): Allow (FILENAME . BUFFER) in TARGET.
Kenichi Handa <handa@m17n.org>
parents:
70704
diff
changeset
|
8407 TARGET may be a cons (FILENAME . BUFFER). In that case, FILENAME is a |
|
71084
ccef92f2f7f8
(Ffind_operation_coding_system): Doc fix.
Richard M. Stallman <rms@gnu.org>
parents:
71070
diff
changeset
|
8408 file name to look up, and BUFFER is a buffer that contains the file's |
|
ccef92f2f7f8
(Ffind_operation_coding_system): Doc fix.
Richard M. Stallman <rms@gnu.org>
parents:
71070
diff
changeset
|
8409 contents (not yet decoded). If `file-coding-system-alist' specifies a |
|
71070
0c8ac7192244
(Ffind_operation_coding_system): Doc fix.
Eli Zaretskii <eliz@gnu.org>
parents:
71039
diff
changeset
|
8410 function to call for FILENAME, that function should examine the |
|
0c8ac7192244
(Ffind_operation_coding_system): Doc fix.
Eli Zaretskii <eliz@gnu.org>
parents:
71039
diff
changeset
|
8411 contents of BUFFER instead of reading the file. |
|
70948
7ea8b1c11d80
(Ffind_operation_coding_system): Allow (FILENAME . BUFFER) in TARGET.
Kenichi Handa <handa@m17n.org>
parents:
70704
diff
changeset
|
8412 |
|
78152
5e5f359984e5
(Ffind_operation_coding_system): Doc fix.
Juanma Barranquero <lekktu@gmail.com>
parents:
75348
diff
changeset
|
8413 usage: (find-operation-coding-system OPERATION ARGUMENTS...) */) |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8414 (nargs, args) |
| 17052 | 8415 int nargs; |
| 8416 Lisp_Object *args; | |
| 8417 { | |
| 8418 Lisp_Object operation, target_idx, target, val; | |
| 8419 register Lisp_Object chain; | |
| 8420 | |
| 8421 if (nargs < 2) | |
| 8422 error ("Too few arguments"); | |
| 8423 operation = args[0]; | |
| 8424 if (!SYMBOLP (operation) | |
| 8425 || !INTEGERP (target_idx = Fget (operation, Qtarget_idx))) | |
| 88365 | 8426 error ("Invalid first arguement"); |
| 17052 | 8427 if (nargs < 1 + XINT (target_idx)) |
| 8428 error ("Too few arguments for operation: %s", | |
|
46370
40db0673e6f0
Most uses of XSTRING combined with STRING_BYTES or indirection changed to
Ken Raeburn <raeburn@raeburn.org>
parents:
46293
diff
changeset
|
8429 SDATA (SYMBOL_NAME (operation))); |
| 17052 | 8430 target = args[XINT (target_idx) + 1]; |
| 8431 if (!(STRINGP (target) | |
|
70948
7ea8b1c11d80
(Ffind_operation_coding_system): Allow (FILENAME . BUFFER) in TARGET.
Kenichi Handa <handa@m17n.org>
parents:
70704
diff
changeset
|
8432 || (EQ (operation, Qinsert_file_contents) && CONSP (target) |
|
7ea8b1c11d80
(Ffind_operation_coding_system): Allow (FILENAME . BUFFER) in TARGET.
Kenichi Handa <handa@m17n.org>
parents:
70704
diff
changeset
|
8433 && STRINGP (XCAR (target)) && BUFFERP (XCDR (target))) |
| 17052 | 8434 || (EQ (operation, Qopen_network_stream) && INTEGERP (target)))) |
| 88365 | 8435 error ("Invalid %dth argument", XINT (target_idx) + 1); |
|
70948
7ea8b1c11d80
(Ffind_operation_coding_system): Allow (FILENAME . BUFFER) in TARGET.
Kenichi Handa <handa@m17n.org>
parents:
70704
diff
changeset
|
8436 if (CONSP (target)) |
|
7ea8b1c11d80
(Ffind_operation_coding_system): Allow (FILENAME . BUFFER) in TARGET.
Kenichi Handa <handa@m17n.org>
parents:
70704
diff
changeset
|
8437 target = XCAR (target); |
| 17052 | 8438 |
|
18613
614b916ff5bf
Fix bugs with inappropriate mixing of Lisp_Object with int.
Richard M. Stallman <rms@gnu.org>
parents:
18536
diff
changeset
|
8439 chain = ((EQ (operation, Qinsert_file_contents) |
|
614b916ff5bf
Fix bugs with inappropriate mixing of Lisp_Object with int.
Richard M. Stallman <rms@gnu.org>
parents:
18536
diff
changeset
|
8440 || EQ (operation, Qwrite_region)) |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8441 ? Vfile_coding_system_alist |
|
18613
614b916ff5bf
Fix bugs with inappropriate mixing of Lisp_Object with int.
Richard M. Stallman <rms@gnu.org>
parents:
18536
diff
changeset
|
8442 : (EQ (operation, Qopen_network_stream) |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8443 ? Vnetwork_coding_system_alist |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8444 : Vprocess_coding_system_alist)); |
| 17052 | 8445 if (NILP (chain)) |
| 8446 return Qnil; | |
| 8447 | |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
8448 for (; CONSP (chain); chain = XCDR (chain)) |
| 17052 | 8449 { |
|
19747
bed06df9cbc5
(setup_coding_system, Ffind_operation_coding_system)
Richard M. Stallman <rms@gnu.org>
parents:
19743
diff
changeset
|
8450 Lisp_Object elt; |
| 88365 | 8451 |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
8452 elt = XCAR (chain); |
| 17052 | 8453 if (CONSP (elt) |
| 8454 && ((STRINGP (target) | |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
8455 && STRINGP (XCAR (elt)) |
|
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
8456 && fast_string_match (XCAR (elt), target) >= 0) |
|
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
8457 || (INTEGERP (target) && EQ (target, XCAR (elt))))) |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8458 { |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
8459 val = XCDR (elt); |
|
19763
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
8460 /* Here, if VAL is both a valid coding system and a valid |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
8461 function symbol, we return VAL as a coding system. */ |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8462 if (CONSP (val)) |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8463 return val; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8464 if (! SYMBOLP (val)) |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8465 return Qnil; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8466 if (! NILP (Fcoding_system_p (val))) |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8467 return Fcons (val, val); |
|
19763
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
8468 if (! NILP (Ffboundp (val))) |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
8469 { |
| 72188 | 8470 /* We use call1 rather than safe_call1 |
| 8471 so as to get bug reports about functions called here | |
| 8472 which don't handle the current interface. */ | |
|
72180
f3bc55b96df5
(Ffind_operation_coding_system): Revert the change from 2006-05-29.
Eli Zaretskii <eliz@gnu.org>
parents:
71972
diff
changeset
|
8473 val = call1 (val, Flist (nargs, args)); |
|
19763
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
8474 if (CONSP (val)) |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
8475 return val; |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
8476 if (SYMBOLP (val) && ! NILP (Fcoding_system_p (val))) |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
8477 return Fcons (val, val); |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
8478 } |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8479 return Qnil; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8480 } |
| 17052 | 8481 } |
| 8482 return Qnil; | |
| 8483 } | |
| 8484 | |
| 88365 | 8485 DEFUN ("set-coding-system-priority", Fset_coding_system_priority, |
|
88845
64b8f6168269
(Fset_coding_system_priority): Allow null arg list.
Dave Love <fx@gnu.org>
parents:
88771
diff
changeset
|
8486 Sset_coding_system_priority, 0, MANY, 0, |
| 88645 | 8487 doc: /* Assign higher priority to the coding systems given as arguments. |
|
89467
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
8488 If multiple coding systems belongs to the same category, |
|
89519
040a08a2a879
(Fread_coding_system): Fix arg of XSETSTRING.
Dave Love <fx@gnu.org>
parents:
89483
diff
changeset
|
8489 all but the first one are ignored. |
|
040a08a2a879
(Fread_coding_system): Fix arg of XSETSTRING.
Dave Love <fx@gnu.org>
parents:
89483
diff
changeset
|
8490 |
|
040a08a2a879
(Fread_coding_system): Fix arg of XSETSTRING.
Dave Love <fx@gnu.org>
parents:
89483
diff
changeset
|
8491 usage: (set-coding-system-priority ...) */) |
| 88365 | 8492 (nargs, args) |
| 8493 int nargs; | |
| 8494 Lisp_Object *args; | |
| 8495 { | |
| 8496 int i, j; | |
| 8497 int changed[coding_category_max]; | |
| 8498 enum coding_category priorities[coding_category_max]; | |
| 8499 | |
| 8500 bzero (changed, sizeof changed); | |
| 8501 | |
| 8502 for (i = j = 0; i < nargs; i++) | |
| 8503 { | |
| 8504 enum coding_category category; | |
| 8505 Lisp_Object spec, attrs; | |
| 8506 | |
| 8507 CHECK_CODING_SYSTEM_GET_SPEC (args[i], spec); | |
| 8508 attrs = AREF (spec, 0); | |
| 8509 category = XINT (CODING_ATTR_CATEGORY (attrs)); | |
| 8510 if (changed[category]) | |
| 8511 /* Ignore this coding system because a coding system of the | |
| 8512 same category already had a higher priority. */ | |
| 8513 continue; | |
| 8514 changed[category] = 1; | |
| 8515 priorities[j++] = category; | |
| 8516 if (coding_categories[category].id >= 0 | |
| 8517 && ! EQ (args[i], CODING_ID_NAME (coding_categories[category].id))) | |
| 8518 setup_coding_system (args[i], &coding_categories[category]); | |
|
89467
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
8519 Fset (AREF (Vcoding_category_table, category), args[i]); |
| 88365 | 8520 } |
| 8521 | |
| 8522 /* Now we have decided top J priorities. Reflect the order of the | |
| 8523 original priorities to the remaining priorities. */ | |
| 8524 | |
| 8525 for (i = j, j = 0; i < coding_category_max; i++, j++) | |
| 8526 { | |
| 8527 while (j < coding_category_max | |
| 8528 && changed[coding_priorities[j]]) | |
| 8529 j++; | |
| 8530 if (j == coding_category_max) | |
| 8531 abort (); | |
| 8532 priorities[i] = coding_priorities[j]; | |
| 8533 } | |
| 8534 | |
| 8535 bcopy (priorities, coding_priorities, sizeof priorities); | |
|
89467
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
8536 |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
8537 /* Update `coding-category-list'. */ |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
8538 Vcoding_category_list = Qnil; |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
8539 for (i = coding_category_max - 1; i >= 0; i--) |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
8540 Vcoding_category_list |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
8541 = Fcons (AREF (Vcoding_category_table, priorities[i]), |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
8542 Vcoding_category_list); |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
8543 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8544 return Qnil; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8545 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8546 |
| 88365 | 8547 DEFUN ("coding-system-priority-list", Fcoding_system_priority_list, |
| 8548 Scoding_system_priority_list, 0, 1, 0, | |
| 88645 | 8549 doc: /* Return a list of coding systems ordered by their priorities. |
| 8550 HIGHESTP non-nil means just return the highest priority one. */) | |
| 88365 | 8551 (highestp) |
| 8552 Lisp_Object highestp; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8553 { |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8554 int i; |
|
22954
928b337d953b
Avoid using initializers for Lisp_Object.
Richard M. Stallman <rms@gnu.org>
parents:
22874
diff
changeset
|
8555 Lisp_Object val; |
|
928b337d953b
Avoid using initializers for Lisp_Object.
Richard M. Stallman <rms@gnu.org>
parents:
22874
diff
changeset
|
8556 |
| 88365 | 8557 for (i = 0, val = Qnil; i < coding_category_max; i++) |
| 8558 { | |
| 8559 enum coding_category category = coding_priorities[i]; | |
| 8560 int id = coding_categories[category].id; | |
| 8561 Lisp_Object attrs; | |
| 8562 | |
| 8563 if (id < 0) | |
| 8564 continue; | |
| 8565 attrs = CODING_ID_ATTRS (id); | |
| 8566 if (! NILP (highestp)) | |
| 8567 return CODING_ATTR_BASE_NAME (attrs); | |
| 8568 val = Fcons (CODING_ATTR_BASE_NAME (attrs), val); | |
| 8569 } | |
| 8570 return Fnreverse (val); | |
| 8571 } | |
| 8572 | |
|
88631
780b91d4a7e5
(setup_iso_safe_charsets): Fix arg decl for K&R.
Dave Love <fx@gnu.org>
parents:
88607
diff
changeset
|
8573 static char *suffixes[] = { "-unix", "-dos", "-mac" }; |
|
780b91d4a7e5
(setup_iso_safe_charsets): Fix arg decl for K&R.
Dave Love <fx@gnu.org>
parents:
88607
diff
changeset
|
8574 |
| 88365 | 8575 static Lisp_Object |
| 8576 make_subsidiaries (base) | |
| 8577 Lisp_Object base; | |
| 8578 { | |
| 8579 Lisp_Object subsidiaries; | |
| 89483 | 8580 int base_name_len = SBYTES (SYMBOL_NAME (base)); |
| 88365 | 8581 char *buf = (char *) alloca (base_name_len + 6); |
| 8582 int i; | |
| 89483 | 8583 |
| 8584 bcopy (SDATA (SYMBOL_NAME (base)), buf, base_name_len); | |
| 88365 | 8585 subsidiaries = Fmake_vector (make_number (3), Qnil); |
| 8586 for (i = 0; i < 3; i++) | |
| 8587 { | |
| 8588 bcopy (suffixes[i], buf + base_name_len, strlen (suffixes[i]) + 1); | |
| 8589 ASET (subsidiaries, i, intern (buf)); | |
| 8590 } | |
| 8591 return subsidiaries; | |
| 8592 } | |
| 8593 | |
|
22226
557fac086b1b
(ascii_skip_code): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22186
diff
changeset
|
8594 |
|
49539
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
8595 DEFUN ("define-coding-system-internal", Fdefine_coding_system_internal, |
| 88365 | 8596 Sdefine_coding_system_internal, coding_arg_max, MANY, 0, |
|
88544
f464d728344c
(Vchar_coding_system_table, Qchar_coding_system):
Dave Love <fx@gnu.org>
parents:
88510
diff
changeset
|
8597 doc: /* For internal use only. |
|
f464d728344c
(Vchar_coding_system_table, Qchar_coding_system):
Dave Love <fx@gnu.org>
parents:
88510
diff
changeset
|
8598 usage: (define-coding-system-internal ...) */) |
| 88365 | 8599 (nargs, args) |
| 8600 int nargs; | |
| 8601 Lisp_Object *args; | |
| 8602 { | |
| 8603 Lisp_Object name; | |
| 8604 Lisp_Object spec_vec; /* [ ATTRS ALIASE EOL_TYPE ] */ | |
| 8605 Lisp_Object attrs; /* Vector of attributes. */ | |
| 8606 Lisp_Object eol_type; | |
| 8607 Lisp_Object aliases; | |
| 8608 Lisp_Object coding_type, charset_list, safe_charsets; | |
| 8609 enum coding_category category; | |
| 8610 Lisp_Object tail, val; | |
| 8611 int max_charset_id = 0; | |
| 8612 int i; | |
| 8613 | |
| 8614 if (nargs < coding_arg_max) | |
| 8615 goto short_args; | |
| 8616 | |
| 8617 attrs = Fmake_vector (make_number (coding_attr_last_index), Qnil); | |
| 8618 | |
| 8619 name = args[coding_arg_name]; | |
| 8620 CHECK_SYMBOL (name); | |
| 8621 CODING_ATTR_BASE_NAME (attrs) = name; | |
| 8622 | |
| 8623 val = args[coding_arg_mnemonic]; | |
| 8624 if (! STRINGP (val)) | |
| 8625 CHECK_CHARACTER (val); | |
| 8626 CODING_ATTR_MNEMONIC (attrs) = val; | |
| 8627 | |
| 8628 coding_type = args[coding_arg_coding_type]; | |
| 8629 CHECK_SYMBOL (coding_type); | |
| 8630 CODING_ATTR_TYPE (attrs) = coding_type; | |
| 8631 | |
| 8632 charset_list = args[coding_arg_charset_list]; | |
| 8633 if (SYMBOLP (charset_list)) | |
| 8634 { | |
| 8635 if (EQ (charset_list, Qiso_2022)) | |
| 8636 { | |
| 8637 if (! EQ (coding_type, Qiso_2022)) | |
| 8638 error ("Invalid charset-list"); | |
| 8639 charset_list = Viso_2022_charset_list; | |
| 8640 } | |
| 8641 else if (EQ (charset_list, Qemacs_mule)) | |
| 8642 { | |
| 8643 if (! EQ (coding_type, Qemacs_mule)) | |
| 8644 error ("Invalid charset-list"); | |
| 8645 charset_list = Vemacs_mule_charset_list; | |
| 8646 } | |
| 8647 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) | |
| 8648 if (max_charset_id < XFASTINT (XCAR (tail))) | |
| 8649 max_charset_id = XFASTINT (XCAR (tail)); | |
| 8650 } | |
| 8651 else | |
| 8652 { | |
| 8653 charset_list = Fcopy_sequence (charset_list); | |
| 91046 | 8654 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) |
| 88365 | 8655 { |
| 8656 struct charset *charset; | |
| 8657 | |
| 91046 | 8658 val = XCAR (tail); |
| 88365 | 8659 CHECK_CHARSET_GET_CHARSET (val, charset); |
| 8660 if (EQ (coding_type, Qiso_2022) | |
| 8661 ? CHARSET_ISO_FINAL (charset) < 0 | |
| 8662 : EQ (coding_type, Qemacs_mule) | |
| 8663 ? CHARSET_EMACS_MULE_ID (charset) < 0 | |
| 8664 : 0) | |
| 8665 error ("Can't handle charset `%s'", | |
| 89483 | 8666 SDATA (SYMBOL_NAME (CHARSET_NAME (charset)))); |
| 8667 | |
| 8668 XSETCAR (tail, make_number (charset->id)); | |
| 88365 | 8669 if (max_charset_id < charset->id) |
| 8670 max_charset_id = charset->id; | |
| 8671 } | |
| 8672 } | |
| 8673 CODING_ATTR_CHARSET_LIST (attrs) = charset_list; | |
| 8674 | |
| 8675 safe_charsets = Fmake_string (make_number (max_charset_id + 1), | |
| 8676 make_number (255)); | |
| 8677 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) | |
| 89483 | 8678 SSET (safe_charsets, XFASTINT (XCAR (tail)), 0); |
| 88365 | 8679 CODING_ATTR_SAFE_CHARSETS (attrs) = safe_charsets; |
| 8680 | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8681 CODING_ATTR_ASCII_COMPAT (attrs) = args[coding_arg_ascii_compatible_p]; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8682 |
| 88365 | 8683 val = args[coding_arg_decode_translation_table]; |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
8684 if (! CHAR_TABLE_P (val) && ! CONSP (val)) |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
8685 CHECK_SYMBOL (val); |
| 88365 | 8686 CODING_ATTR_DECODE_TBL (attrs) = val; |
| 8687 | |
| 8688 val = args[coding_arg_encode_translation_table]; | |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
8689 if (! CHAR_TABLE_P (val) && ! CONSP (val)) |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
8690 CHECK_SYMBOL (val); |
| 88365 | 8691 CODING_ATTR_ENCODE_TBL (attrs) = val; |
| 8692 | |
| 8693 val = args[coding_arg_post_read_conversion]; | |
| 8694 CHECK_SYMBOL (val); | |
| 8695 CODING_ATTR_POST_READ (attrs) = val; | |
| 8696 | |
| 8697 val = args[coding_arg_pre_write_conversion]; | |
| 8698 CHECK_SYMBOL (val); | |
| 8699 CODING_ATTR_PRE_WRITE (attrs) = val; | |
| 8700 | |
| 8701 val = args[coding_arg_default_char]; | |
| 8702 if (NILP (val)) | |
| 8703 CODING_ATTR_DEFAULT_CHAR (attrs) = make_number (' '); | |
| 8704 else | |
| 8705 { | |
| 89483 | 8706 CHECK_CHARACTER (val); |
| 88365 | 8707 CODING_ATTR_DEFAULT_CHAR (attrs) = val; |
| 8708 } | |
| 8709 | |
| 89483 | 8710 val = args[coding_arg_for_unibyte]; |
| 8711 CODING_ATTR_FOR_UNIBYTE (attrs) = NILP (val) ? Qnil : Qt; | |
| 8712 | |
| 88365 | 8713 val = args[coding_arg_plist]; |
| 8714 CHECK_LIST (val); | |
| 8715 CODING_ATTR_PLIST (attrs) = val; | |
| 8716 | |
| 8717 if (EQ (coding_type, Qcharset)) | |
| 8718 { | |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8719 /* Generate a lisp vector of 256 elements. Each element is nil, |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8720 integer, or a list of charset IDs. |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8721 |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8722 If Nth element is nil, the byte code N is invalid in this |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8723 coding system. |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8724 |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8725 If Nth element is a number NUM, N is the first byte of a |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8726 charset whose ID is NUM. |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8727 |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8728 If Nth element is a list of charset IDs, N is the first byte |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8729 of one of them. The list is sorted by dimensions of the |
|
89648
d5641a606e08
(Fdefine_coding_system_internal): Fix checking of ascii compatibility.
Kenichi Handa <handa@m17n.org>
parents:
89644
diff
changeset
|
8730 charsets. A charset of smaller dimension comes firtst. */ |
| 88365 | 8731 val = Fmake_vector (make_number (256), Qnil); |
| 8732 | |
|
89653
cbaa9fd1aa5c
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89648
diff
changeset
|
8733 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) |
| 88365 | 8734 { |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8735 struct charset *charset = CHARSET_FROM_ID (XFASTINT (XCAR (tail))); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8736 int dim = CHARSET_DIMENSION (charset); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8737 int idx = (dim - 1) * 4; |
| 89483 | 8738 |
|
89653
cbaa9fd1aa5c
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89648
diff
changeset
|
8739 if (CHARSET_ASCII_COMPATIBLE_P (charset)) |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8740 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8741 |
|
88477
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
8742 for (i = charset->code_space[idx]; |
|
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
8743 i <= charset->code_space[idx + 1]; i++) |
|
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
8744 { |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8745 Lisp_Object tmp, tmp2; |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8746 int dim2; |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8747 |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8748 tmp = AREF (val, i); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8749 if (NILP (tmp)) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8750 tmp = XCAR (tail); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8751 else if (NUMBERP (tmp)) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8752 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8753 dim2 = CHARSET_DIMENSION (CHARSET_FROM_ID (XFASTINT (tmp))); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8754 if (dim < dim2) |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
8755 tmp = Fcons (XCAR (tail), Fcons (tmp, Qnil)); |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8756 else |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
8757 tmp = Fcons (tmp, Fcons (XCAR (tail), Qnil)); |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8758 } |
|
88477
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
8759 else |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8760 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8761 for (tmp2 = tmp; CONSP (tmp2); tmp2 = XCDR (tmp2)) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8762 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8763 dim2 = CHARSET_DIMENSION (CHARSET_FROM_ID (XFASTINT (XCAR (tmp2)))); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8764 if (dim < dim2) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8765 break; |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8766 } |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8767 if (NILP (tmp2)) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8768 tmp = nconc2 (tmp, Fcons (XCAR (tail), Qnil)); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8769 else |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8770 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8771 XSETCDR (tmp2, Fcons (XCAR (tmp2), XCDR (tmp2))); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8772 XSETCAR (tmp2, XCAR (tail)); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8773 } |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8774 } |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
8775 ASET (val, i, tmp); |
|
88477
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
8776 } |
| 88365 | 8777 } |
| 8778 ASET (attrs, coding_attr_charset_valids, val); | |
| 8779 category = coding_category_charset; | |
| 8780 } | |
| 8781 else if (EQ (coding_type, Qccl)) | |
| 8782 { | |
| 8783 Lisp_Object valids; | |
| 89483 | 8784 |
| 88365 | 8785 if (nargs < coding_arg_ccl_max) |
| 8786 goto short_args; | |
| 8787 | |
| 8788 val = args[coding_arg_ccl_decoder]; | |
| 8789 CHECK_CCL_PROGRAM (val); | |
| 8790 if (VECTORP (val)) | |
| 8791 val = Fcopy_sequence (val); | |
| 8792 ASET (attrs, coding_attr_ccl_decoder, val); | |
| 8793 | |
| 8794 val = args[coding_arg_ccl_encoder]; | |
| 8795 CHECK_CCL_PROGRAM (val); | |
| 8796 if (VECTORP (val)) | |
| 8797 val = Fcopy_sequence (val); | |
| 8798 ASET (attrs, coding_attr_ccl_encoder, val); | |
| 8799 | |
| 8800 val = args[coding_arg_ccl_valids]; | |
| 8801 valids = Fmake_string (make_number (256), make_number (0)); | |
| 8802 for (tail = val; !NILP (tail); tail = Fcdr (tail)) | |
| 8803 { | |
|
89373
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8804 int from, to; |
|
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8805 |
| 88365 | 8806 val = Fcar (tail); |
| 8807 if (INTEGERP (val)) | |
|
89373
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8808 { |
|
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8809 from = to = XINT (val); |
|
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8810 if (from < 0 || from > 255) |
|
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8811 args_out_of_range_3 (val, make_number (0), make_number (255)); |
|
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8812 } |
| 88365 | 8813 else |
| 8814 { | |
| 8815 CHECK_CONS (val); | |
| 89483 | 8816 CHECK_NATNUM_CAR (val); |
| 8817 CHECK_NATNUM_CDR (val); | |
| 88365 | 8818 from = XINT (XCAR (val)); |
| 89483 | 8819 if (from > 255) |
|
89373
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8820 args_out_of_range_3 (XCAR (val), |
|
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8821 make_number (0), make_number (255)); |
| 88365 | 8822 to = XINT (XCDR (val)); |
|
89373
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8823 if (to < from || to > 255) |
|
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8824 args_out_of_range_3 (XCDR (val), |
|
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8825 XCAR (val), make_number (255)); |
| 88365 | 8826 } |
|
89373
4cc9e57fcabc
(decode_coding_ccl, encode_coding_ccl): Call ccl_driver
Kenichi Handa <handa@m17n.org>
parents:
89331
diff
changeset
|
8827 for (i = from; i <= to; i++) |
| 89483 | 8828 SSET (valids, i, 1); |
| 88365 | 8829 } |
| 8830 ASET (attrs, coding_attr_ccl_valids, valids); | |
| 89483 | 8831 |
| 88365 | 8832 category = coding_category_ccl; |
| 8833 } | |
| 8834 else if (EQ (coding_type, Qutf_16)) | |
| 8835 { | |
| 8836 Lisp_Object bom, endian; | |
| 8837 | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8838 CODING_ATTR_ASCII_COMPAT (attrs) = Qnil; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8839 |
| 88365 | 8840 if (nargs < coding_arg_utf16_max) |
| 8841 goto short_args; | |
| 8842 | |
| 8843 bom = args[coding_arg_utf16_bom]; | |
| 8844 if (! NILP (bom) && ! EQ (bom, Qt)) | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
8845 { |
| 88365 | 8846 CHECK_CONS (bom); |
| 89483 | 8847 val = XCAR (bom); |
| 8848 CHECK_CODING_SYSTEM (val); | |
| 8849 val = XCDR (bom); | |
| 8850 CHECK_CODING_SYSTEM (val); | |
| 88365 | 8851 } |
| 8852 ASET (attrs, coding_attr_utf_16_bom, bom); | |
| 8853 | |
| 8854 endian = args[coding_arg_utf16_endian]; | |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
8855 CHECK_SYMBOL (endian); |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
8856 if (NILP (endian)) |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
8857 endian = Qbig; |
|
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
8858 else if (! EQ (endian, Qbig) && ! EQ (endian, Qlittle)) |
| 89483 | 8859 error ("Invalid endian: %s", SDATA (SYMBOL_NAME (endian))); |
| 88365 | 8860 ASET (attrs, coding_attr_utf_16_endian, endian); |
| 8861 | |
| 8862 category = (CONSP (bom) | |
| 8863 ? coding_category_utf_16_auto | |
| 8864 : NILP (bom) | |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
8865 ? (EQ (endian, Qbig) |
| 88365 | 8866 ? coding_category_utf_16_be_nosig |
| 8867 : coding_category_utf_16_le_nosig) | |
|
89420
c3e67ce6ee0f
(Qsignature, Qendian): Delete these variables.
Kenichi Handa <handa@m17n.org>
parents:
89418
diff
changeset
|
8868 : (EQ (endian, Qbig) |
| 88365 | 8869 ? coding_category_utf_16_be |
| 8870 : coding_category_utf_16_le)); | |
| 8871 } | |
| 8872 else if (EQ (coding_type, Qiso_2022)) | |
| 8873 { | |
| 8874 Lisp_Object initial, reg_usage, request, flags; | |
|
89442
7349f4473e7f
(detected_mask): Delete unused variable.
Kenichi Handa <handa@m17n.org>
parents:
89429
diff
changeset
|
8875 int i; |
| 88365 | 8876 |
| 8877 if (nargs < coding_arg_iso2022_max) | |
| 8878 goto short_args; | |
| 8879 | |
| 8880 initial = Fcopy_sequence (args[coding_arg_iso2022_initial]); | |
| 8881 CHECK_VECTOR (initial); | |
| 8882 for (i = 0; i < 4; i++) | |
| 8883 { | |
| 8884 val = Faref (initial, make_number (i)); | |
| 8885 if (! NILP (val)) | |
| 8886 { | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8887 struct charset *charset; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8888 |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8889 CHECK_CHARSET_GET_CHARSET (val, charset); |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8890 ASET (initial, i, make_number (CHARSET_ID (charset))); |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8891 if (i == 0 && CHARSET_ASCII_COMPATIBLE_P (charset)) |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8892 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
| 88365 | 8893 } |
| 8894 else | |
| 8895 ASET (initial, i, make_number (-1)); | |
| 8896 } | |
| 8897 | |
| 8898 reg_usage = args[coding_arg_iso2022_reg_usage]; | |
| 8899 CHECK_CONS (reg_usage); | |
| 89483 | 8900 CHECK_NUMBER_CAR (reg_usage); |
| 8901 CHECK_NUMBER_CDR (reg_usage); | |
| 88365 | 8902 |
| 8903 request = Fcopy_sequence (args[coding_arg_iso2022_request]); | |
| 8904 for (tail = request; ! NILP (tail); tail = Fcdr (tail)) | |
| 8905 { | |
| 8906 int id; | |
| 89483 | 8907 Lisp_Object tmp; |
| 88365 | 8908 |
| 8909 val = Fcar (tail); | |
| 8910 CHECK_CONS (val); | |
| 89483 | 8911 tmp = XCAR (val); |
| 8912 CHECK_CHARSET_GET_ID (tmp, id); | |
| 8913 CHECK_NATNUM_CDR (val); | |
| 88365 | 8914 if (XINT (XCDR (val)) >= 4) |
| 8915 error ("Invalid graphic register number: %d", XINT (XCDR (val))); | |
| 89483 | 8916 XSETCAR (val, make_number (id)); |
| 88365 | 8917 } |
| 8918 | |
| 8919 flags = args[coding_arg_iso2022_flags]; | |
| 8920 CHECK_NATNUM (flags); | |
| 8921 i = XINT (flags); | |
| 8922 if (EQ (args[coding_arg_charset_list], Qiso_2022)) | |
| 8923 flags = make_number (i | CODING_ISO_FLAG_FULL_SUPPORT); | |
| 8924 | |
| 8925 ASET (attrs, coding_attr_iso_initial, initial); | |
| 8926 ASET (attrs, coding_attr_iso_usage, reg_usage); | |
| 8927 ASET (attrs, coding_attr_iso_request, request); | |
| 8928 ASET (attrs, coding_attr_iso_flags, flags); | |
| 8929 setup_iso_safe_charsets (attrs); | |
| 8930 | |
| 8931 if (i & CODING_ISO_FLAG_SEVEN_BITS) | |
| 8932 category = ((i & (CODING_ISO_FLAG_LOCKING_SHIFT | |
| 8933 | CODING_ISO_FLAG_SINGLE_SHIFT)) | |
| 8934 ? coding_category_iso_7_else | |
| 8935 : EQ (args[coding_arg_charset_list], Qiso_2022) | |
| 8936 ? coding_category_iso_7 | |
| 8937 : coding_category_iso_7_tight); | |
| 8938 else | |
| 8939 { | |
| 8940 int id = XINT (AREF (initial, 1)); | |
| 8941 | |
|
88977
3b05c02eebf2
(Fdefine_coding_system_internal): Fix category setting
Kenichi Handa <handa@m17n.org>
parents:
88950
diff
changeset
|
8942 category = (((i & CODING_ISO_FLAG_LOCKING_SHIFT) |
| 88365 | 8943 || EQ (args[coding_arg_charset_list], Qiso_2022) |
| 8944 || id < 0) | |
| 8945 ? coding_category_iso_8_else | |
| 8946 : (CHARSET_DIMENSION (CHARSET_FROM_ID (id)) == 1) | |
| 8947 ? coding_category_iso_8_1 | |
| 8948 : coding_category_iso_8_2); | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
8949 } |
|
89227
101ee928c088
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89225
diff
changeset
|
8950 if (category != coding_category_iso_8_1 |
|
101ee928c088
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89225
diff
changeset
|
8951 && category != coding_category_iso_8_2) |
|
101ee928c088
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89225
diff
changeset
|
8952 CODING_ATTR_ASCII_COMPAT (attrs) = Qnil; |
| 88365 | 8953 } |
| 8954 else if (EQ (coding_type, Qemacs_mule)) | |
| 8955 { | |
| 8956 if (EQ (args[coding_arg_charset_list], Qemacs_mule)) | |
| 8957 ASET (attrs, coding_attr_emacs_mule_full, Qt); | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8958 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
| 88365 | 8959 category = coding_category_emacs_mule; |
| 8960 } | |
| 8961 else if (EQ (coding_type, Qshift_jis)) | |
| 8962 { | |
| 8963 | |
| 8964 struct charset *charset; | |
| 8965 | |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
8966 if (XINT (Flength (charset_list)) != 3 |
|
89739
293c9235be3f
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89732
diff
changeset
|
8967 && XINT (Flength (charset_list)) != 4) |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
8968 error ("There should be three or four charsets"); |
| 88365 | 8969 |
| 8970 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 8971 if (CHARSET_DIMENSION (charset) != 1) | |
| 8972 error ("Dimension of charset %s is not one", | |
| 89483 | 8973 SDATA (SYMBOL_NAME (CHARSET_NAME (charset)))); |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8974 if (CHARSET_ASCII_COMPATIBLE_P (charset)) |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
8975 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
| 88365 | 8976 |
| 8977 charset_list = XCDR (charset_list); | |
| 8978 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 8979 if (CHARSET_DIMENSION (charset) != 1) | |
| 8980 error ("Dimension of charset %s is not one", | |
| 89483 | 8981 SDATA (SYMBOL_NAME (CHARSET_NAME (charset)))); |
| 88365 | 8982 |
| 8983 charset_list = XCDR (charset_list); | |
| 8984 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 8985 if (CHARSET_DIMENSION (charset) != 2) | |
| 8986 error ("Dimension of charset %s is not two", | |
| 89483 | 8987 SDATA (SYMBOL_NAME (CHARSET_NAME (charset)))); |
| 88365 | 8988 |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
8989 charset_list = XCDR (charset_list); |
|
89740
78c1fd14ed42
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89739
diff
changeset
|
8990 if (! NILP (charset_list)) |
|
78c1fd14ed42
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89739
diff
changeset
|
8991 { |
|
78c1fd14ed42
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89739
diff
changeset
|
8992 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); |
|
78c1fd14ed42
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89739
diff
changeset
|
8993 if (CHARSET_DIMENSION (charset) != 2) |
|
78c1fd14ed42
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89739
diff
changeset
|
8994 error ("Dimension of charset %s is not two", |
|
78c1fd14ed42
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89739
diff
changeset
|
8995 SDATA (SYMBOL_NAME (CHARSET_NAME (charset)))); |
|
78c1fd14ed42
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89739
diff
changeset
|
8996 } |
|
89732
8acde12aba89
(get_translation_table): New function.
Kenichi Handa <handa@m17n.org>
parents:
89730
diff
changeset
|
8997 |
| 88365 | 8998 category = coding_category_sjis; |
| 8999 Vsjis_coding_system = name; | |
| 9000 } | |
| 9001 else if (EQ (coding_type, Qbig5)) | |
| 9002 { | |
| 9003 struct charset *charset; | |
| 9004 | |
| 9005 if (XINT (Flength (charset_list)) != 2) | |
| 9006 error ("There should be just two charsets"); | |
| 9007 | |
| 9008 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 9009 if (CHARSET_DIMENSION (charset) != 1) | |
| 9010 error ("Dimension of charset %s is not one", | |
| 89483 | 9011 SDATA (SYMBOL_NAME (CHARSET_NAME (charset)))); |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9012 if (CHARSET_ASCII_COMPATIBLE_P (charset)) |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9013 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
| 88365 | 9014 |
| 9015 charset_list = XCDR (charset_list); | |
| 9016 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 9017 if (CHARSET_DIMENSION (charset) != 2) | |
| 9018 error ("Dimension of charset %s is not two", | |
| 89483 | 9019 SDATA (SYMBOL_NAME (CHARSET_NAME (charset)))); |
| 88365 | 9020 |
| 9021 category = coding_category_big5; | |
| 9022 Vbig5_coding_system = name; | |
| 9023 } | |
| 9024 else if (EQ (coding_type, Qraw_text)) | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9025 { |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9026 category = coding_category_raw_text; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9027 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9028 } |
| 88365 | 9029 else if (EQ (coding_type, Qutf_8)) |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9030 { |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9031 category = coding_category_utf_8; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9032 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
9033 } |
| 88365 | 9034 else if (EQ (coding_type, Qundecided)) |
| 9035 category = coding_category_undecided; | |
| 9036 else | |
| 9037 error ("Invalid coding system type: %s", | |
| 89483 | 9038 SDATA (SYMBOL_NAME (coding_type))); |
| 88365 | 9039 |
| 9040 CODING_ATTR_CATEGORY (attrs) = make_number (category); | |
|
89468
7dbbe692f70c
* coding.c (QCcategory): New variable.
Kenichi Handa <handa@m17n.org>
parents:
89467
diff
changeset
|
9041 CODING_ATTR_PLIST (attrs) |
|
7dbbe692f70c
* coding.c (QCcategory): New variable.
Kenichi Handa <handa@m17n.org>
parents:
89467
diff
changeset
|
9042 = Fcons (QCcategory, Fcons (AREF (Vcoding_category_table, category), |
|
7dbbe692f70c
* coding.c (QCcategory): New variable.
Kenichi Handa <handa@m17n.org>
parents:
89467
diff
changeset
|
9043 CODING_ATTR_PLIST (attrs))); |
|
90214
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9044 CODING_ATTR_PLIST (attrs) |
|
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9045 = Fcons (QCascii_compatible_p, |
|
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9046 Fcons (CODING_ATTR_ASCII_COMPAT (attrs), |
|
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9047 CODING_ATTR_PLIST (attrs))); |
| 88365 | 9048 |
| 9049 eol_type = args[coding_arg_eol_type]; | |
| 9050 if (! NILP (eol_type) | |
| 9051 && ! EQ (eol_type, Qunix) | |
| 9052 && ! EQ (eol_type, Qdos) | |
| 9053 && ! EQ (eol_type, Qmac)) | |
| 9054 error ("Invalid eol-type"); | |
| 9055 | |
| 9056 aliases = Fcons (name, Qnil); | |
| 9057 | |
| 9058 if (NILP (eol_type)) | |
| 9059 { | |
| 9060 eol_type = make_subsidiaries (name); | |
| 9061 for (i = 0; i < 3; i++) | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
9062 { |
| 88365 | 9063 Lisp_Object this_spec, this_name, this_aliases, this_eol_type; |
| 9064 | |
| 9065 this_name = AREF (eol_type, i); | |
| 9066 this_aliases = Fcons (this_name, Qnil); | |
| 9067 this_eol_type = (i == 0 ? Qunix : i == 1 ? Qdos : Qmac); | |
| 9068 this_spec = Fmake_vector (make_number (3), attrs); | |
| 9069 ASET (this_spec, 1, this_aliases); | |
| 9070 ASET (this_spec, 2, this_eol_type); | |
| 9071 Fputhash (this_name, this_spec, Vcoding_system_hash_table); | |
| 9072 Vcoding_system_list = Fcons (this_name, Vcoding_system_list); | |
|
90289
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9073 val = Fassoc (Fsymbol_name (this_name), Vcoding_system_alist); |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9074 if (NILP (val)) |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9075 Vcoding_system_alist |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9076 = Fcons (Fcons (Fsymbol_name (this_name), Qnil), |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9077 Vcoding_system_alist); |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
9078 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9079 } |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
9080 |
| 88365 | 9081 spec_vec = Fmake_vector (make_number (3), attrs); |
| 9082 ASET (spec_vec, 1, aliases); | |
| 9083 ASET (spec_vec, 2, eol_type); | |
| 9084 | |
| 9085 Fputhash (name, spec_vec, Vcoding_system_hash_table); | |
| 9086 Vcoding_system_list = Fcons (name, Vcoding_system_list); | |
|
90289
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9087 val = Fassoc (Fsymbol_name (name), Vcoding_system_alist); |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9088 if (NILP (val)) |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9089 Vcoding_system_alist = Fcons (Fcons (Fsymbol_name (name), Qnil), |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9090 Vcoding_system_alist); |
| 88365 | 9091 |
| 9092 { | |
| 9093 int id = coding_categories[category].id; | |
| 9094 | |
| 9095 if (id < 0 || EQ (name, CODING_ID_NAME (id))) | |
| 9096 setup_coding_system (name, &coding_categories[category]); | |
| 9097 } | |
| 9098 | |
| 9099 return Qnil; | |
| 9100 | |
| 9101 short_args: | |
| 9102 return Fsignal (Qwrong_number_of_arguments, | |
| 9103 Fcons (intern ("define-coding-system-internal"), | |
| 9104 make_number (nargs))); | |
| 9105 } | |
| 9106 | |
|
89571
242f2cc0134b
(Fdefine_coding_system_alias): Update Vcoding_system_list.
Kenichi Handa <handa@m17n.org>
parents:
89562
diff
changeset
|
9107 |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9108 DEFUN ("coding-system-put", Fcoding_system_put, Scoding_system_put, |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9109 3, 3, 0, |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9110 doc: /* Change value in CODING-SYSTEM's property list PROP to VAL. */) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9111 (coding_system, prop, val) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9112 Lisp_Object coding_system, prop, val; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9113 { |
|
89924
7d0f6da3ea6e
(detect_coding): Delete unused variables.
Kenichi Handa <handa@m17n.org>
parents:
89917
diff
changeset
|
9114 Lisp_Object spec, attrs; |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9115 |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9116 CHECK_CODING_SYSTEM_GET_SPEC (coding_system, spec); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9117 attrs = AREF (spec, 0); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9118 if (EQ (prop, QCmnemonic)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9119 { |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9120 if (! STRINGP (val)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9121 CHECK_CHARACTER (val); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9122 CODING_ATTR_MNEMONIC (attrs) = val; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9123 } |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9124 else if (EQ (prop, QCdefalut_char)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9125 { |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9126 if (NILP (val)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9127 val = make_number (' '); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9128 else |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9129 CHECK_CHARACTER (val); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9130 CODING_ATTR_DEFAULT_CHAR (attrs) = val; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9131 } |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9132 else if (EQ (prop, QCdecode_translation_table)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9133 { |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9134 if (! CHAR_TABLE_P (val) && ! CONSP (val)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9135 CHECK_SYMBOL (val); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9136 CODING_ATTR_DECODE_TBL (attrs) = val; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9137 } |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9138 else if (EQ (prop, QCencode_translation_table)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9139 { |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9140 if (! CHAR_TABLE_P (val) && ! CONSP (val)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9141 CHECK_SYMBOL (val); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9142 CODING_ATTR_ENCODE_TBL (attrs) = val; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9143 } |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9144 else if (EQ (prop, QCpost_read_conversion)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9145 { |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9146 CHECK_SYMBOL (val); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9147 CODING_ATTR_POST_READ (attrs) = val; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9148 } |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9149 else if (EQ (prop, QCpre_write_conversion)) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9150 { |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9151 CHECK_SYMBOL (val); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9152 CODING_ATTR_PRE_WRITE (attrs) = val; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9153 } |
|
90214
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9154 else if (EQ (prop, QCascii_compatible_p)) |
|
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9155 { |
|
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9156 CODING_ATTR_ASCII_COMPAT (attrs) = val; |
|
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9157 } |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9158 |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9159 CODING_ATTR_PLIST (attrs) |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9160 = Fplist_put (CODING_ATTR_PLIST (attrs), prop, val); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9161 return val; |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9162 } |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9163 |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9164 |
| 88365 | 9165 DEFUN ("define-coding-system-alias", Fdefine_coding_system_alias, |
| 9166 Sdefine_coding_system_alias, 2, 2, 0, | |
| 9167 doc: /* Define ALIAS as an alias for CODING-SYSTEM. */) | |
| 9168 (alias, coding_system) | |
| 9169 Lisp_Object alias, coding_system; | |
| 9170 { | |
|
90289
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9171 Lisp_Object spec, aliases, eol_type, val; |
| 88365 | 9172 |
| 9173 CHECK_SYMBOL (alias); | |
| 9174 CHECK_CODING_SYSTEM_GET_SPEC (coding_system, spec); | |
| 9175 aliases = AREF (spec, 1); | |
|
89571
242f2cc0134b
(Fdefine_coding_system_alias): Update Vcoding_system_list.
Kenichi Handa <handa@m17n.org>
parents:
89562
diff
changeset
|
9176 /* ALISES should be a list of length more than zero, and the first |
|
242f2cc0134b
(Fdefine_coding_system_alias): Update Vcoding_system_list.
Kenichi Handa <handa@m17n.org>
parents:
89562
diff
changeset
|
9177 element is a base coding system. Append ALIAS at the tail of the |
|
242f2cc0134b
(Fdefine_coding_system_alias): Update Vcoding_system_list.
Kenichi Handa <handa@m17n.org>
parents:
89562
diff
changeset
|
9178 list. */ |
| 88365 | 9179 while (!NILP (XCDR (aliases))) |
| 9180 aliases = XCDR (aliases); | |
| 89483 | 9181 XSETCDR (aliases, Fcons (alias, Qnil)); |
| 88365 | 9182 |
| 9183 eol_type = AREF (spec, 2); | |
| 9184 if (VECTORP (eol_type)) | |
| 9185 { | |
| 9186 Lisp_Object subsidiaries; | |
| 9187 int i; | |
| 9188 | |
| 9189 subsidiaries = make_subsidiaries (alias); | |
| 9190 for (i = 0; i < 3; i++) | |
| 9191 Fdefine_coding_system_alias (AREF (subsidiaries, i), | |
| 9192 AREF (eol_type, i)); | |
| 9193 } | |
| 9194 | |
| 9195 Fputhash (alias, spec, Vcoding_system_hash_table); | |
|
89571
242f2cc0134b
(Fdefine_coding_system_alias): Update Vcoding_system_list.
Kenichi Handa <handa@m17n.org>
parents:
89562
diff
changeset
|
9196 Vcoding_system_list = Fcons (alias, Vcoding_system_list); |
|
90289
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9197 val = Fassoc (Fsymbol_name (alias), Vcoding_system_alist); |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9198 if (NILP (val)) |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9199 Vcoding_system_alist = Fcons (Fcons (Fsymbol_name (alias), Qnil), |
|
72d8a45f6c9f
(Fdefine_coding_system_internal): Avoid a duplicated
Kenichi Handa <handa@m17n.org>
parents:
90272
diff
changeset
|
9200 Vcoding_system_alist); |
| 88365 | 9201 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9202 return Qnil; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9203 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9204 |
| 88365 | 9205 DEFUN ("coding-system-base", Fcoding_system_base, Scoding_system_base, |
| 9206 1, 1, 0, | |
| 9207 doc: /* Return the base of CODING-SYSTEM. | |
| 88645 | 9208 Any alias or subsidiary coding system is not a base coding system. */) |
| 88365 | 9209 (coding_system) |
| 9210 Lisp_Object coding_system; | |
| 9211 { | |
| 9212 Lisp_Object spec, attrs; | |
| 9213 | |
| 9214 if (NILP (coding_system)) | |
| 9215 return (Qno_conversion); | |
| 9216 CHECK_CODING_SYSTEM_GET_SPEC (coding_system, spec); | |
| 9217 attrs = AREF (spec, 0); | |
| 9218 return CODING_ATTR_BASE_NAME (attrs); | |
| 9219 } | |
| 9220 | |
| 9221 DEFUN ("coding-system-plist", Fcoding_system_plist, Scoding_system_plist, | |
| 9222 1, 1, 0, | |
| 9223 doc: "Return the property list of CODING-SYSTEM.") | |
|
49539
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
9224 (coding_system) |
|
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
9225 Lisp_Object coding_system; |
|
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
9226 { |
| 88365 | 9227 Lisp_Object spec, attrs; |
| 9228 | |
| 9229 if (NILP (coding_system)) | |
| 9230 coding_system = Qno_conversion; | |
| 9231 CHECK_CODING_SYSTEM_GET_SPEC (coding_system, spec); | |
| 9232 attrs = AREF (spec, 0); | |
| 9233 return CODING_ATTR_PLIST (attrs); | |
| 9234 } | |
| 9235 | |
| 9236 | |
| 9237 DEFUN ("coding-system-aliases", Fcoding_system_aliases, Scoding_system_aliases, | |
| 9238 1, 1, 0, | |
| 88645 | 9239 doc: /* Return the list of aliases of CODING-SYSTEM. */) |
| 88365 | 9240 (coding_system) |
| 9241 Lisp_Object coding_system; | |
| 9242 { | |
| 9243 Lisp_Object spec; | |
| 9244 | |
| 9245 if (NILP (coding_system)) | |
| 9246 coding_system = Qno_conversion; | |
| 9247 CHECK_CODING_SYSTEM_GET_SPEC (coding_system, spec); | |
| 88645 | 9248 return AREF (spec, 1); |
| 88365 | 9249 } |
| 9250 | |
| 9251 DEFUN ("coding-system-eol-type", Fcoding_system_eol_type, | |
| 9252 Scoding_system_eol_type, 1, 1, 0, | |
| 9253 doc: /* Return eol-type of CODING-SYSTEM. | |
| 9254 An eol-type is integer 0, 1, 2, or a vector of coding systems. | |
| 9255 | |
| 9256 Integer values 0, 1, and 2 indicate a format of end-of-line; LF, CRLF, | |
| 9257 and CR respectively. | |
| 9258 | |
| 9259 A vector value indicates that a format of end-of-line should be | |
| 9260 detected automatically. Nth element of the vector is the subsidiary | |
| 9261 coding system whose eol-type is N. */) | |
| 9262 (coding_system) | |
| 9263 Lisp_Object coding_system; | |
| 9264 { | |
| 9265 Lisp_Object spec, eol_type; | |
| 9266 int n; | |
| 9267 | |
| 9268 if (NILP (coding_system)) | |
| 9269 coding_system = Qno_conversion; | |
| 9270 if (! CODING_SYSTEM_P (coding_system)) | |
| 9271 return Qnil; | |
| 9272 spec = CODING_SYSTEM_SPEC (coding_system); | |
| 9273 eol_type = AREF (spec, 2); | |
| 9274 if (VECTORP (eol_type)) | |
| 9275 return Fcopy_sequence (eol_type); | |
| 9276 n = EQ (eol_type, Qunix) ? 0 : EQ (eol_type, Qdos) ? 1 : 2; | |
| 9277 return make_number (n); | |
|
49539
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
9278 } |
|
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
9279 |
| 17052 | 9280 #endif /* emacs */ |
| 9281 | |
| 9282 | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
9283 /*** 9. Post-amble ***/ |
| 17052 | 9284 |
| 21514 | 9285 void |
| 17052 | 9286 init_coding_once () |
| 9287 { | |
| 9288 int i; | |
| 9289 | |
| 88365 | 9290 for (i = 0; i < coding_category_max; i++) |
| 9291 { | |
| 9292 coding_categories[i].id = -1; | |
| 9293 coding_priorities[i] = i; | |
| 9294 } | |
| 17052 | 9295 |
| 9296 /* ISO2022 specific initialize routine. */ | |
| 9297 for (i = 0; i < 0x20; i++) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
9298 iso_code_class[i] = ISO_control_0; |
| 17052 | 9299 for (i = 0x21; i < 0x7F; i++) |
| 9300 iso_code_class[i] = ISO_graphic_plane_0; | |
| 9301 for (i = 0x80; i < 0xA0; i++) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
9302 iso_code_class[i] = ISO_control_1; |
| 17052 | 9303 for (i = 0xA1; i < 0xFF; i++) |
| 9304 iso_code_class[i] = ISO_graphic_plane_1; | |
| 9305 iso_code_class[0x20] = iso_code_class[0x7F] = ISO_0x20_or_0x7F; | |
| 9306 iso_code_class[0xA0] = iso_code_class[0xFF] = ISO_0xA0_or_0xFF; | |
| 9307 iso_code_class[ISO_CODE_SO] = ISO_shift_out; | |
| 9308 iso_code_class[ISO_CODE_SI] = ISO_shift_in; | |
| 9309 iso_code_class[ISO_CODE_SS2_7] = ISO_single_shift_2_7; | |
| 9310 iso_code_class[ISO_CODE_ESC] = ISO_escape; | |
| 9311 iso_code_class[ISO_CODE_SS2] = ISO_single_shift_2; | |
| 9312 iso_code_class[ISO_CODE_SS3] = ISO_single_shift_3; | |
| 9313 iso_code_class[ISO_CODE_CSI] = ISO_control_sequence_introducer; | |
| 9314 | |
| 88365 | 9315 for (i = 0; i < 256; i++) |
| 9316 { | |
| 9317 emacs_mule_bytes[i] = 1; | |
| 9318 } | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
9319 emacs_mule_bytes[EMACS_MULE_LEADING_CODE_PRIVATE_11] = 3; |
|
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
9320 emacs_mule_bytes[EMACS_MULE_LEADING_CODE_PRIVATE_12] = 3; |
|
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
9321 emacs_mule_bytes[EMACS_MULE_LEADING_CODE_PRIVATE_21] = 4; |
|
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
9322 emacs_mule_bytes[EMACS_MULE_LEADING_CODE_PRIVATE_22] = 4; |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9323 } |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9324 |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9325 #ifdef emacs |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9326 |
| 21514 | 9327 void |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9328 syms_of_coding () |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9329 { |
| 88365 | 9330 staticpro (&Vcoding_system_hash_table); |
| 89483 | 9331 { |
| 9332 Lisp_Object args[2]; | |
| 9333 args[0] = QCtest; | |
| 9334 args[1] = Qeq; | |
| 9335 Vcoding_system_hash_table = Fmake_hash_table (2, args); | |
| 9336 } | |
| 88365 | 9337 |
| 9338 staticpro (&Vsjis_coding_system); | |
| 9339 Vsjis_coding_system = Qnil; | |
| 9340 | |
| 9341 staticpro (&Vbig5_coding_system); | |
| 9342 Vbig5_coding_system = Qnil; | |
| 9343 | |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
9344 staticpro (&Vcode_conversion_reused_workbuf); |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
9345 Vcode_conversion_reused_workbuf = Qnil; |
|
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
9346 |
|
58637
ff8a37b5299b
(Vcode_conversion_workbuf_name): New variable.
Kenichi Handa <handa@m17n.org>
parents:
58502
diff
changeset
|
9347 staticpro (&Vcode_conversion_workbuf_name); |
|
ff8a37b5299b
(Vcode_conversion_workbuf_name): New variable.
Kenichi Handa <handa@m17n.org>
parents:
58502
diff
changeset
|
9348 Vcode_conversion_workbuf_name = build_string (" *code-conversion-work*"); |
|
ff8a37b5299b
(Vcode_conversion_workbuf_name): New variable.
Kenichi Handa <handa@m17n.org>
parents:
58502
diff
changeset
|
9349 |
|
89665
9010cefe8d29
(enum iso_code_class_type): Delete ISO_carriage_return.
Kenichi Handa <handa@m17n.org>
parents:
89653
diff
changeset
|
9350 reused_workbuf_in_use = 0; |
| 88365 | 9351 |
| 9352 DEFSYM (Qcharset, "charset"); | |
| 9353 DEFSYM (Qtarget_idx, "target-idx"); | |
| 9354 DEFSYM (Qcoding_system_history, "coding-system-history"); | |
|
19750
95e4e1cba6ac
(Qcoding_system_history): New variable.
Richard M. Stallman <rms@gnu.org>
parents:
19747
diff
changeset
|
9355 Fset (Qcoding_system_history, Qnil); |
|
95e4e1cba6ac
(Qcoding_system_history): New variable.
Richard M. Stallman <rms@gnu.org>
parents:
19747
diff
changeset
|
9356 |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9357 /* Target FILENAME is the first argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9358 Fput (Qinsert_file_contents, Qtarget_idx, make_number (0)); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9359 /* Target FILENAME is the third argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9360 Fput (Qwrite_region, Qtarget_idx, make_number (2)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9361 |
| 88365 | 9362 DEFSYM (Qcall_process, "call-process"); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9363 /* Target PROGRAM is the first argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9364 Fput (Qcall_process, Qtarget_idx, make_number (0)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9365 |
| 88365 | 9366 DEFSYM (Qcall_process_region, "call-process-region"); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9367 /* Target PROGRAM is the third argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9368 Fput (Qcall_process_region, Qtarget_idx, make_number (2)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9369 |
| 88365 | 9370 DEFSYM (Qstart_process, "start-process"); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9371 /* Target PROGRAM is the third argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9372 Fput (Qstart_process, Qtarget_idx, make_number (2)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9373 |
| 88365 | 9374 DEFSYM (Qopen_network_stream, "open-network-stream"); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9375 /* Target SERVICE is the fourth argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9376 Fput (Qopen_network_stream, Qtarget_idx, make_number (3)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
9377 |
| 88365 | 9378 DEFSYM (Qcoding_system, "coding-system"); |
| 9379 DEFSYM (Qcoding_aliases, "coding-aliases"); | |
| 9380 | |
| 9381 DEFSYM (Qeol_type, "eol-type"); | |
| 9382 DEFSYM (Qunix, "unix"); | |
| 9383 DEFSYM (Qdos, "dos"); | |
| 9384 | |
| 9385 DEFSYM (Qbuffer_file_coding_system, "buffer-file-coding-system"); | |
| 9386 DEFSYM (Qpost_read_conversion, "post-read-conversion"); | |
| 9387 DEFSYM (Qpre_write_conversion, "pre-write-conversion"); | |
| 9388 DEFSYM (Qdefault_char, "default-char"); | |
| 9389 DEFSYM (Qundecided, "undecided"); | |
| 9390 DEFSYM (Qno_conversion, "no-conversion"); | |
| 9391 DEFSYM (Qraw_text, "raw-text"); | |
| 9392 | |
| 9393 DEFSYM (Qiso_2022, "iso-2022"); | |
| 9394 | |
| 9395 DEFSYM (Qutf_8, "utf-8"); | |
| 89483 | 9396 DEFSYM (Qutf_8_emacs, "utf-8-emacs"); |
| 88365 | 9397 |
| 9398 DEFSYM (Qutf_16, "utf-16"); | |
| 9399 DEFSYM (Qbig, "big"); | |
| 9400 DEFSYM (Qlittle, "little"); | |
| 9401 | |
| 9402 DEFSYM (Qshift_jis, "shift-jis"); | |
| 9403 DEFSYM (Qbig5, "big5"); | |
| 9404 | |
| 9405 DEFSYM (Qcoding_system_p, "coding-system-p"); | |
| 9406 | |
| 9407 DEFSYM (Qcoding_system_error, "coding-system-error"); | |
| 17052 | 9408 Fput (Qcoding_system_error, Qerror_conditions, |
| 9409 Fcons (Qcoding_system_error, Fcons (Qerror, Qnil))); | |
| 9410 Fput (Qcoding_system_error, Qerror_message, | |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9411 build_string ("Invalid coding system")); |
| 17052 | 9412 |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
9413 /* Intern this now in case it isn't already done. |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
9414 Setting this variable twice is harmless. |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
9415 But don't staticpro it here--that is done in alloc.c. */ |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
9416 Qchar_table_extra_slots = intern ("char-table-extra-slots"); |
| 88365 | 9417 |
| 9418 DEFSYM (Qtranslation_table, "translation-table"); | |
|
89856
18b52da60a76
(get_translation): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89852
diff
changeset
|
9419 Fput (Qtranslation_table, Qchar_table_extra_slots, make_number (2)); |
| 88365 | 9420 DEFSYM (Qtranslation_table_id, "translation-table-id"); |
| 9421 DEFSYM (Qtranslation_table_for_decode, "translation-table-for-decode"); | |
| 9422 DEFSYM (Qtranslation_table_for_encode, "translation-table-for-encode"); | |
| 9423 | |
| 9424 DEFSYM (Qvalid_codes, "valid-codes"); | |
| 9425 | |
| 9426 DEFSYM (Qemacs_mule, "emacs-mule"); | |
| 9427 | |
|
89468
7dbbe692f70c
* coding.c (QCcategory): New variable.
Kenichi Handa <handa@m17n.org>
parents:
89467
diff
changeset
|
9428 DEFSYM (QCcategory, ":category"); |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9429 DEFSYM (QCmnemonic, ":mnemonic"); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9430 DEFSYM (QCdefalut_char, ":default-char"); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9431 DEFSYM (QCdecode_translation_table, ":decode-translation-table"); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9432 DEFSYM (QCencode_translation_table, ":encode-translation-table"); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9433 DEFSYM (QCpost_read_conversion, ":post-read-conversion"); |
|
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9434 DEFSYM (QCpre_write_conversion, ":pre-write-conversion"); |
|
90214
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9435 DEFSYM (QCascii_compatible_p, ":ascii-compatible-p"); |
|
89468
7dbbe692f70c
* coding.c (QCcategory): New variable.
Kenichi Handa <handa@m17n.org>
parents:
89467
diff
changeset
|
9436 |
| 88365 | 9437 Vcoding_category_table |
| 9438 = Fmake_vector (make_number (coding_category_max), Qnil); | |
| 9439 staticpro (&Vcoding_category_table); | |
| 9440 /* Followings are target of code detection. */ | |
| 9441 ASET (Vcoding_category_table, coding_category_iso_7, | |
| 9442 intern ("coding-category-iso-7")); | |
| 9443 ASET (Vcoding_category_table, coding_category_iso_7_tight, | |
| 9444 intern ("coding-category-iso-7-tight")); | |
| 9445 ASET (Vcoding_category_table, coding_category_iso_8_1, | |
| 9446 intern ("coding-category-iso-8-1")); | |
| 9447 ASET (Vcoding_category_table, coding_category_iso_8_2, | |
| 9448 intern ("coding-category-iso-8-2")); | |
| 9449 ASET (Vcoding_category_table, coding_category_iso_7_else, | |
| 9450 intern ("coding-category-iso-7-else")); | |
| 9451 ASET (Vcoding_category_table, coding_category_iso_8_else, | |
| 9452 intern ("coding-category-iso-8-else")); | |
| 9453 ASET (Vcoding_category_table, coding_category_utf_8, | |
| 9454 intern ("coding-category-utf-8")); | |
| 9455 ASET (Vcoding_category_table, coding_category_utf_16_be, | |
| 9456 intern ("coding-category-utf-16-be")); | |
|
89467
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
9457 ASET (Vcoding_category_table, coding_category_utf_16_auto, |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
9458 intern ("coding-category-utf-16-auto")); |
| 88365 | 9459 ASET (Vcoding_category_table, coding_category_utf_16_le, |
| 9460 intern ("coding-category-utf-16-le")); | |
| 9461 ASET (Vcoding_category_table, coding_category_utf_16_be_nosig, | |
| 9462 intern ("coding-category-utf-16-be-nosig")); | |
| 9463 ASET (Vcoding_category_table, coding_category_utf_16_le_nosig, | |
| 9464 intern ("coding-category-utf-16-le-nosig")); | |
| 9465 ASET (Vcoding_category_table, coding_category_charset, | |
| 9466 intern ("coding-category-charset")); | |
| 9467 ASET (Vcoding_category_table, coding_category_sjis, | |
| 9468 intern ("coding-category-sjis")); | |
| 9469 ASET (Vcoding_category_table, coding_category_big5, | |
| 9470 intern ("coding-category-big5")); | |
| 9471 ASET (Vcoding_category_table, coding_category_ccl, | |
| 9472 intern ("coding-category-ccl")); | |
| 9473 ASET (Vcoding_category_table, coding_category_emacs_mule, | |
| 9474 intern ("coding-category-emacs-mule")); | |
| 9475 /* Followings are NOT target of code detection. */ | |
| 9476 ASET (Vcoding_category_table, coding_category_raw_text, | |
| 9477 intern ("coding-category-raw-text")); | |
| 9478 ASET (Vcoding_category_table, coding_category_undecided, | |
| 9479 intern ("coding-category-undecided")); | |
| 9480 | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9481 DEFSYM (Qinsufficient_source, "insufficient-source"); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9482 DEFSYM (Qinconsistent_eol, "inconsistent-eol"); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9483 DEFSYM (Qinvalid_source, "invalid-source"); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9484 DEFSYM (Qinterrupted, "interrupted"); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9485 DEFSYM (Qinsufficient_memory, "insufficient-memory"); |
|
90272
f1df126ec7de
Sync to HEAD for handling autoload-coding-system.
Kenichi Handa <handa@m17n.org>
parents:
90263
diff
changeset
|
9486 DEFSYM (Qcoding_system_define_form, "coding-system-define-form"); |
|
52794
f4d906e31662
(Qcoding_system_define_form): New variable.
Kenichi Handa <handa@m17n.org>
parents:
52401
diff
changeset
|
9487 |
| 17052 | 9488 defsubr (&Scoding_system_p); |
| 9489 defsubr (&Sread_coding_system); | |
| 9490 defsubr (&Sread_non_nil_coding_system); | |
| 9491 defsubr (&Scheck_coding_system); | |
| 9492 defsubr (&Sdetect_coding_region); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9493 defsubr (&Sdetect_coding_string); |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
9494 defsubr (&Sfind_coding_systems_region_internal); |
|
46859
a26dd8891732
(unencodable_char_position): New function.
Kenichi Handa <handa@m17n.org>
parents:
46839
diff
changeset
|
9495 defsubr (&Sunencodable_char_position); |
| 88365 | 9496 defsubr (&Scheck_coding_systems_region); |
| 17052 | 9497 defsubr (&Sdecode_coding_region); |
| 9498 defsubr (&Sencode_coding_region); | |
| 9499 defsubr (&Sdecode_coding_string); | |
| 9500 defsubr (&Sencode_coding_string); | |
| 9501 defsubr (&Sdecode_sjis_char); | |
| 9502 defsubr (&Sencode_sjis_char); | |
| 9503 defsubr (&Sdecode_big5_char); | |
| 9504 defsubr (&Sencode_big5_char); | |
|
18002
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
9505 defsubr (&Sset_terminal_coding_system_internal); |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
9506 defsubr (&Sset_safe_terminal_coding_system_internal); |
| 17052 | 9507 defsubr (&Sterminal_coding_system); |
|
18002
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
9508 defsubr (&Sset_keyboard_coding_system_internal); |
| 17052 | 9509 defsubr (&Skeyboard_coding_system); |
|
18536
69c0e220b626
(Vstandard_character_unification_table_for_decode):
Kenichi Handa <handa@m17n.org>
parents:
18523
diff
changeset
|
9510 defsubr (&Sfind_operation_coding_system); |
| 88365 | 9511 defsubr (&Sset_coding_system_priority); |
|
49539
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
9512 defsubr (&Sdefine_coding_system_internal); |
| 88365 | 9513 defsubr (&Sdefine_coding_system_alias); |
|
89759
d11866e9fbf4
(QCmnemonic, QCdefalut_char)
Kenichi Handa <handa@m17n.org>
parents:
89740
diff
changeset
|
9514 defsubr (&Scoding_system_put); |
| 88365 | 9515 defsubr (&Scoding_system_base); |
| 9516 defsubr (&Scoding_system_plist); | |
| 9517 defsubr (&Scoding_system_aliases); | |
| 9518 defsubr (&Scoding_system_eol_type); | |
| 9519 defsubr (&Scoding_system_priority_list); | |
| 17052 | 9520 |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
9521 DEFVAR_LISP ("coding-system-list", &Vcoding_system_list, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9522 doc: /* List of coding systems. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9523 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9524 Do not alter the value of this variable manually. This variable should be |
| 88365 | 9525 updated by the functions `define-coding-system' and |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9526 `define-coding-system-alias'. */); |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
9527 Vcoding_system_list = Qnil; |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
9528 |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
9529 DEFVAR_LISP ("coding-system-alist", &Vcoding_system_alist, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9530 doc: /* Alist of coding system names. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9531 Each element is one element list of coding system name. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9532 This variable is given to `completing-read' as TABLE argument. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9533 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9534 Do not alter the value of this variable manually. This variable should be |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9535 updated by the functions `make-coding-system' and |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9536 `define-coding-system-alias'. */); |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
9537 Vcoding_system_alist = Qnil; |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
9538 |
| 17052 | 9539 DEFVAR_LISP ("coding-category-list", &Vcoding_category_list, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9540 doc: /* List of coding-categories (symbols) ordered by priority. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9541 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9542 On detecting a coding system, Emacs tries code detection algorithms |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9543 associated with each coding-category one by one in this order. When |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9544 one algorithm agrees with a byte sequence of source text, the coding |
|
60608
4b80e9c28e8f
(syms_of_coding): Docstring of coding-category-list fixed.
Kenichi Handa <handa@m17n.org>
parents:
60031
diff
changeset
|
9545 system bound to the corresponding coding-category is selected. |
|
4b80e9c28e8f
(syms_of_coding): Docstring of coding-category-list fixed.
Kenichi Handa <handa@m17n.org>
parents:
60031
diff
changeset
|
9546 |
|
61166
e3a6dd630fdf
(Vcoding_category_list): Docstring fix.
Kenichi Handa <handa@m17n.org>
parents:
60907
diff
changeset
|
9547 Don't modify this variable directly, but use `set-coding-priority'. */); |
| 17052 | 9548 { |
| 9549 int i; | |
| 9550 | |
| 9551 Vcoding_category_list = Qnil; | |
| 88365 | 9552 for (i = coding_category_max - 1; i >= 0; i--) |
| 17052 | 9553 Vcoding_category_list |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9554 = Fcons (XVECTOR (Vcoding_category_table)->contents[i], |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9555 Vcoding_category_list); |
| 17052 | 9556 } |
| 9557 | |
| 9558 DEFVAR_LISP ("coding-system-for-read", &Vcoding_system_for_read, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9559 doc: /* Specify the coding system for read operations. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9560 It is useful to bind this variable with `let', but do not set it globally. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9561 If the value is a coding system, it is used for decoding on read operation. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9562 If not, an appropriate element is used from one of the coding system alists: |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9563 There are three such tables, `file-coding-system-alist', |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9564 `process-coding-system-alist', and `network-coding-system-alist'. */); |
| 17052 | 9565 Vcoding_system_for_read = Qnil; |
| 9566 | |
| 9567 DEFVAR_LISP ("coding-system-for-write", &Vcoding_system_for_write, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9568 doc: /* Specify the coding system for write operations. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9569 Programs bind this variable with `let', but you should not set it globally. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9570 If the value is a coding system, it is used for encoding of output, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9571 when writing it to a file and when sending it to a file or subprocess. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9572 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9573 If this does not specify a coding system, an appropriate element |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9574 is used from one of the coding system alists: |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9575 There are three such tables, `file-coding-system-alist', |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9576 `process-coding-system-alist', and `network-coding-system-alist'. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9577 For output to files, if the above procedure does not specify a coding system, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9578 the value of `buffer-file-coding-system' is used. */); |
| 17052 | 9579 Vcoding_system_for_write = Qnil; |
| 9580 | |
| 9581 DEFVAR_LISP ("last-coding-system-used", &Vlast_coding_system_used, | |
| 88365 | 9582 doc: /* |
| 9583 Coding system used in the latest file or process I/O. */); | |
| 17052 | 9584 Vlast_coding_system_used = Qnil; |
| 9585 | |
|
89686
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9586 DEFVAR_LISP ("last-code-conversion-error", &Vlast_code_conversion_error, |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9587 doc: /* |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9588 Error status of the last code conversion. |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9589 |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9590 When an error was detected in the last code conversion, this variable |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9591 is set to one of the following symbols. |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9592 `insufficient-source' |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9593 `inconsistent-eol' |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9594 `invalid-source' |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9595 `interrupted' |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9596 `insufficient-memory' |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9597 When no error was detected, the value doesn't change. So, to check |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9598 the error status of a code conversion by this variable, you must |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9599 explicitly set this variable to nil before performing code |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9600 conversion. */); |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9601 Vlast_code_conversion_error = Qnil; |
|
9bfefb13fe83
(Qinsufficient_source, Qinconsistent_eol)
Kenichi Handa <handa@m17n.org>
parents:
89676
diff
changeset
|
9602 |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9603 DEFVAR_BOOL ("inhibit-eol-conversion", &inhibit_eol_conversion, |
| 88365 | 9604 doc: /* |
| 9605 *Non-nil means always inhibit code conversion of end-of-line format. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9606 See info node `Coding Systems' and info node `Text and Binary' concerning |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9607 such conversion. */); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9608 inhibit_eol_conversion = 0; |
|
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
9609 |
|
21574
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
9610 DEFVAR_BOOL ("inherit-process-coding-system", &inherit_process_coding_system, |
| 88365 | 9611 doc: /* |
| 9612 Non-nil means process buffer inherits coding system of process output. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9613 Bind it to t if the process output is to be treated as if it were a file |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9614 read from some filesystem. */); |
|
21574
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
9615 inherit_process_coding_system = 0; |
|
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
9616 |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9617 DEFVAR_LISP ("file-coding-system-alist", &Vfile_coding_system_alist, |
| 88365 | 9618 doc: /* |
| 9619 Alist to decide a coding system to use for a file I/O operation. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9620 The format is ((PATTERN . VAL) ...), |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9621 where PATTERN is a regular expression matching a file name, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9622 VAL is a coding system, a cons of coding systems, or a function symbol. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9623 If VAL is a coding system, it is used for both decoding and encoding |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9624 the file contents. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9625 If VAL is a cons of coding systems, the car part is used for decoding, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9626 and the cdr part is used for encoding. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9627 If VAL is a function symbol, the function must return a coding system |
|
72323
af796bc81ff0
(syms_of_coding): Improve the docstring
Kenichi Handa <handa@m17n.org>
parents:
72188
diff
changeset
|
9628 or a cons of coding systems which are used as above. The function is |
|
af796bc81ff0
(syms_of_coding): Improve the docstring
Kenichi Handa <handa@m17n.org>
parents:
72188
diff
changeset
|
9629 called with an argument that is a list of the arguments with which |
|
81611
ae42ad5f89e6
(Ffind_operation_coding_system): Docstring improved.
Kenichi Handa <handa@m17n.org>
parents:
75348
diff
changeset
|
9630 `find-operation-coding-system' was called. If the function can't decide |
|
ae42ad5f89e6
(Ffind_operation_coding_system): Docstring improved.
Kenichi Handa <handa@m17n.org>
parents:
75348
diff
changeset
|
9631 a coding system, it can return `undecided' so that the normal |
|
ae42ad5f89e6
(Ffind_operation_coding_system): Docstring improved.
Kenichi Handa <handa@m17n.org>
parents:
75348
diff
changeset
|
9632 code-detection is performed. |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9633 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9634 See also the function `find-operation-coding-system' |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9635 and the variable `auto-coding-alist'. */); |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9636 Vfile_coding_system_alist = Qnil; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9637 |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9638 DEFVAR_LISP ("process-coding-system-alist", &Vprocess_coding_system_alist, |
| 88365 | 9639 doc: /* |
| 9640 Alist to decide a coding system to use for a process I/O operation. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9641 The format is ((PATTERN . VAL) ...), |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9642 where PATTERN is a regular expression matching a program name, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9643 VAL is a coding system, a cons of coding systems, or a function symbol. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9644 If VAL is a coding system, it is used for both decoding what received |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9645 from the program and encoding what sent to the program. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9646 If VAL is a cons of coding systems, the car part is used for decoding, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9647 and the cdr part is used for encoding. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9648 If VAL is a function symbol, the function must return a coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9649 or a cons of coding systems which are used as above. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9650 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9651 See also the function `find-operation-coding-system'. */); |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9652 Vprocess_coding_system_alist = Qnil; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9653 |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9654 DEFVAR_LISP ("network-coding-system-alist", &Vnetwork_coding_system_alist, |
| 88365 | 9655 doc: /* |
| 9656 Alist to decide a coding system to use for a network I/O operation. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9657 The format is ((PATTERN . VAL) ...), |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9658 where PATTERN is a regular expression matching a network service name |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9659 or is a port number to connect to, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9660 VAL is a coding system, a cons of coding systems, or a function symbol. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9661 If VAL is a coding system, it is used for both decoding what received |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9662 from the network stream and encoding what sent to the network stream. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9663 If VAL is a cons of coding systems, the car part is used for decoding, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9664 and the cdr part is used for encoding. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9665 If VAL is a function symbol, the function must return a coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9666 or a cons of coding systems which are used as above. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9667 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9668 See also the function `find-operation-coding-system'. */); |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9669 Vnetwork_coding_system_alist = Qnil; |
| 17052 | 9670 |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9671 DEFVAR_LISP ("locale-coding-system", &Vlocale_coding_system, |
|
41026
6f20449b7e12
(syms_of_coding): Doc fix.
Richard M. Stallman <rms@gnu.org>
parents:
41006
diff
changeset
|
9672 doc: /* Coding system to use with system messages. |
|
6f20449b7e12
(syms_of_coding): Doc fix.
Richard M. Stallman <rms@gnu.org>
parents:
41006
diff
changeset
|
9673 Also used for decoding keyboard input on X Window system. */); |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9674 Vlocale_coding_system = Qnil; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9675 |
|
29182
1d1c27067af4
(encode_eol): Add null statement after label.
Dave Love <fx@gnu.org>
parents:
29172
diff
changeset
|
9676 /* The eol mnemonics are reset in startup.el system-dependently. */ |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9677 DEFVAR_LISP ("eol-mnemonic-unix", &eol_mnemonic_unix, |
| 88365 | 9678 doc: /* |
| 9679 *String displayed in mode line for UNIX-like (LF) end-of-line format. */); | |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9680 eol_mnemonic_unix = build_string (":"); |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9681 |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9682 DEFVAR_LISP ("eol-mnemonic-dos", &eol_mnemonic_dos, |
| 88365 | 9683 doc: /* |
| 9684 *String displayed in mode line for DOS-like (CRLF) end-of-line format. */); | |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9685 eol_mnemonic_dos = build_string ("\\"); |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9686 |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9687 DEFVAR_LISP ("eol-mnemonic-mac", &eol_mnemonic_mac, |
| 88365 | 9688 doc: /* |
| 9689 *String displayed in mode line for MAC-like (CR) end-of-line format. */); | |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9690 eol_mnemonic_mac = build_string ("/"); |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9691 |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9692 DEFVAR_LISP ("eol-mnemonic-undecided", &eol_mnemonic_undecided, |
| 88365 | 9693 doc: /* |
| 9694 *String displayed in mode line when end-of-line format is not yet determined. */); | |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
9695 eol_mnemonic_undecided = build_string (":"); |
| 17052 | 9696 |
|
22119
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
9697 DEFVAR_LISP ("enable-character-translation", &Venable_character_translation, |
| 88365 | 9698 doc: /* |
| 9699 *Non-nil enables character translation while encoding and decoding. */); | |
|
22119
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
9700 Venable_character_translation = Qt; |
|
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
9701 |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
9702 DEFVAR_LISP ("standard-translation-table-for-decode", |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9703 &Vstandard_translation_table_for_decode, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9704 doc: /* Table for translating characters while decoding. */); |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
9705 Vstandard_translation_table_for_decode = Qnil; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
9706 |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
9707 DEFVAR_LISP ("standard-translation-table-for-encode", |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9708 &Vstandard_translation_table_for_encode, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9709 doc: /* Table for translating characters while encoding. */); |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
9710 Vstandard_translation_table_for_encode = Qnil; |
| 17052 | 9711 |
| 88365 | 9712 DEFVAR_LISP ("charset-revision-table", &Vcharset_revision_table, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9713 doc: /* Alist of charsets vs revision numbers. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9714 While encoding, if a charset (car part of an element) is found, |
| 88365 | 9715 designate it with the escape sequence identifying revision (cdr part |
| 9716 of the element). */); | |
| 9717 Vcharset_revision_table = Qnil; | |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9718 |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9719 DEFVAR_LISP ("default-process-coding-system", |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9720 &Vdefault_process_coding_system, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9721 doc: /* Cons of coding systems used for process I/O by default. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9722 The car part is used for decoding a process output, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9723 the cdr part is used for encoding a text to be sent to a process. */); |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
9724 Vdefault_process_coding_system = Qnil; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
9725 |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
9726 DEFVAR_LISP ("latin-extra-code-table", &Vlatin_extra_code_table, |
| 88365 | 9727 doc: /* |
| 9728 Table of extra Latin codes in the range 128..159 (inclusive). | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9729 This is a vector of length 256. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9730 If Nth element is non-nil, the existence of code N in a file |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9731 \(or output of subprocess) doesn't prevent it to be detected as |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9732 a coding system of ISO 2022 variant which has a flag |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9733 `accept-latin-extra-code' t (e.g. iso-latin-1) on reading a file |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9734 or reading output of a subprocess. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9735 Only 128th through 159th elements has a meaning. */); |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
9736 Vlatin_extra_code_table = Fmake_vector (make_number (256), Qnil); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9737 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9738 DEFVAR_LISP ("select-safe-coding-system-function", |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9739 &Vselect_safe_coding_system_function, |
| 88365 | 9740 doc: /* |
| 9741 Function to call to select safe coding system for encoding a text. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9742 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9743 If set, this function is called to force a user to select a proper |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9744 coding system which can encode the text in the case that a default |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9745 coding system used in each operation can't encode the text. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9746 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9747 The default value is `select-safe-coding-system' (which see). */); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9748 Vselect_safe_coding_system_function = Qnil; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
9749 |
|
48874
3002a87cc629
(coding_system_require_warning): New variable.
Kenichi Handa <handa@m17n.org>
parents:
48829
diff
changeset
|
9750 DEFVAR_BOOL ("coding-system-require-warning", |
|
3002a87cc629
(coding_system_require_warning): New variable.
Kenichi Handa <handa@m17n.org>
parents:
48829
diff
changeset
|
9751 &coding_system_require_warning, |
|
3002a87cc629
(coding_system_require_warning): New variable.
Kenichi Handa <handa@m17n.org>
parents:
48829
diff
changeset
|
9752 doc: /* Internal use only. |
|
49539
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
9753 If non-nil, on writing a file, `select-safe-coding-system-function' is |
|
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
9754 called even if `coding-system-for-write' is non-nil. The command |
|
1ad5bfbb831a
(syms_of_coding): Add `...' for symbols in the docstring of
Kenichi Handa <handa@m17n.org>
parents:
48874
diff
changeset
|
9755 `universal-coding-system-argument' binds this variable to t temporarily. */); |
|
48874
3002a87cc629
(coding_system_require_warning): New variable.
Kenichi Handa <handa@m17n.org>
parents:
48829
diff
changeset
|
9756 coding_system_require_warning = 0; |
|
3002a87cc629
(coding_system_require_warning): New variable.
Kenichi Handa <handa@m17n.org>
parents:
48829
diff
changeset
|
9757 |
|
3002a87cc629
(coding_system_require_warning): New variable.
Kenichi Handa <handa@m17n.org>
parents:
48829
diff
changeset
|
9758 |
|
30292
14a9937df1f5
(syms_of_coding): Fix typo in spelling of variable
Gerd Moellmann <gerd@gnu.org>
parents:
30263
diff
changeset
|
9759 DEFVAR_BOOL ("inhibit-iso-escape-detection", |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
9760 &inhibit_iso_escape_detection, |
| 88365 | 9761 doc: /* |
| 9762 If non-nil, Emacs ignores ISO2022's escape sequence on code detection. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9763 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9764 By default, on reading a file, Emacs tries to detect how the text is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9765 encoded. This code detection is sensitive to escape sequences. If |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9766 the sequence is valid as ISO2022, the code is determined as one of |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9767 the ISO2022 encodings, and the file is decoded by the corresponding |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9768 coding system (e.g. `iso-2022-7bit'). |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9769 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9770 However, there may be a case that you want to read escape sequences in |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9771 a file as is. In such a case, you can set this variable to non-nil. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9772 Then, as the code detection ignores any escape sequences, no file is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9773 detected as encoded in some ISO2022 encoding. The result is that all |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9774 escape sequences become visible in a buffer. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9775 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9776 The default value is nil, and it is strongly recommended not to change |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9777 it. That is because many Emacs Lisp source files that contain |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9778 non-ASCII characters are encoded by the coding system `iso-2022-7bit' |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9779 in Emacs's distribution, and they won't be decoded correctly on |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9780 reading if you suppress escape sequence detection. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9781 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9782 The other way to read escape sequences in a file without decoding is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9783 to explicitly specify some coding system that doesn't use ISO2022's |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
9784 escape sequence (e.g `latin-1') on reading by \\[universal-coding-system-argument]. */); |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
9785 inhibit_iso_escape_detection = 0; |
|
48182
9474e269efd1
Reformat some DEFUNs so that etags works.
Dave Love <fx@gnu.org>
parents:
48125
diff
changeset
|
9786 |
|
9474e269efd1
Reformat some DEFUNs so that etags works.
Dave Love <fx@gnu.org>
parents:
48125
diff
changeset
|
9787 DEFVAR_LISP ("translation-table-for-input", &Vtranslation_table_for_input, |
|
48230
c2ce8280fb97
(Vtranslation_table_for_input): New.
Dave Love <fx@gnu.org>
parents:
48182
diff
changeset
|
9788 doc: /* Char table for translating self-inserting characters. |
|
c2ce8280fb97
(Vtranslation_table_for_input): New.
Dave Love <fx@gnu.org>
parents:
48182
diff
changeset
|
9789 This is applied to the result of input methods, not their input. See also |
|
c2ce8280fb97
(Vtranslation_table_for_input): New.
Dave Love <fx@gnu.org>
parents:
48182
diff
changeset
|
9790 `keyboard-translate-table'. */); |
|
48182
9474e269efd1
Reformat some DEFUNs so that etags works.
Dave Love <fx@gnu.org>
parents:
48125
diff
changeset
|
9791 Vtranslation_table_for_input = Qnil; |
| 89483 | 9792 |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9793 { |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9794 Lisp_Object args[coding_arg_max]; |
| 89483 | 9795 Lisp_Object plist[16]; |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9796 int i; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9797 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9798 for (i = 0; i < coding_arg_max; i++) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9799 args[i] = Qnil; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9800 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9801 plist[0] = intern (":name"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9802 plist[1] = args[coding_arg_name] = Qno_conversion; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9803 plist[2] = intern (":mnemonic"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9804 plist[3] = args[coding_arg_mnemonic] = make_number ('='); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9805 plist[4] = intern (":coding-type"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9806 plist[5] = args[coding_arg_coding_type] = Qraw_text; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9807 plist[6] = intern (":ascii-compatible-p"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9808 plist[7] = args[coding_arg_ascii_compatible_p] = Qt; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9809 plist[8] = intern (":default-char"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9810 plist[9] = args[coding_arg_default_char] = make_number (0); |
| 89483 | 9811 plist[10] = intern (":for-unibyte"); |
| 9812 plist[11] = args[coding_arg_for_unibyte] = Qt; | |
| 9813 plist[12] = intern (":docstring"); | |
| 9814 plist[13] = build_string ("Do no conversion.\n\ | |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9815 \n\ |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9816 When you visit a file with this coding, the file is read into a\n\ |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9817 unibyte buffer as is, thus each byte of a file is treated as a\n\ |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9818 character."); |
| 89483 | 9819 plist[14] = intern (":eol-type"); |
| 9820 plist[15] = args[coding_arg_eol_type] = Qunix; | |
| 9821 args[coding_arg_plist] = Flist (16, plist); | |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9822 Fdefine_coding_system_internal (coding_arg_max, args); |
|
90011
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9823 |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9824 plist[1] = args[coding_arg_name] = Qundecided; |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9825 plist[3] = args[coding_arg_mnemonic] = make_number ('-'); |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9826 plist[5] = args[coding_arg_coding_type] = Qundecided; |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9827 /* This is already set. |
|
90214
460ee00505d5
(QCascii_compatible_p): New variable.
Kenichi Handa <handa@m17n.org>
parents:
90201
diff
changeset
|
9828 plist[7] = args[coding_arg_ascii_compatible_p] = Qt; */ |
|
90011
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9829 plist[8] = intern (":charset-list"); |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9830 plist[9] = args[coding_arg_charset_list] = Fcons (Qascii, Qnil); |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9831 plist[11] = args[coding_arg_for_unibyte] = Qnil; |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9832 plist[13] = build_string ("No conversion on encoding, automatic conversion on decoding."); |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9833 plist[15] = args[coding_arg_eol_type] = Qnil; |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9834 args[coding_arg_plist] = Flist (16, plist); |
|
26cef35a1562
(setup_coding_system): If coding_system is nil, use
Kenichi Handa <handa@m17n.org>
parents:
89976
diff
changeset
|
9835 Fdefine_coding_system_internal (coding_arg_max, args); |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9836 } |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9837 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
9838 setup_coding_system (Qno_conversion, &safe_terminal_coding); |
|
89467
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
9839 |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
9840 { |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
9841 int i; |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
9842 |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
9843 for (i = 0; i < coding_category_max; i++) |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
9844 Fset (AREF (Vcoding_category_table, i), Qno_conversion); |
|
e911ca706166
(Fset_coding_system_priority): Doc fix. Update values
Kenichi Handa <handa@m17n.org>
parents:
89462
diff
changeset
|
9845 } |
|
90394
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
9846 #if defined (MSDOS) || defined (WINDOWSNT) |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
9847 system_eol_type = Qdos; |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
9848 #else |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
9849 system_eol_type = Qunix; |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
9850 #endif |
|
263867fe7b55
(system_eol_type): Sync with HEAD.
Kenichi Handa <handa@m17n.org>
parents:
90380
diff
changeset
|
9851 staticpro (&system_eol_type); |
| 17052 | 9852 } |
| 9853 | |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9854 char * |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9855 emacs_strerror (error_number) |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9856 int error_number; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9857 { |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9858 char *str; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9859 |
|
26526
b7438760079b
* callproc.c (strerror): Remove decl.
Paul Eggert <eggert@twinsun.com>
parents:
26240
diff
changeset
|
9860 synchronize_system_messages_locale (); |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9861 str = strerror (error_number); |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9862 |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9863 if (! NILP (Vlocale_coding_system)) |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9864 { |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9865 Lisp_Object dec = code_convert_string_norecord (build_string (str), |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9866 Vlocale_coding_system, |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9867 0); |
|
46370
40db0673e6f0
Most uses of XSTRING combined with STRING_BYTES or indirection changed to
Ken Raeburn <raeburn@raeburn.org>
parents:
46293
diff
changeset
|
9868 str = (char *) SDATA (dec); |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9869 } |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9870 |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9871 return str; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9872 } |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
9873 |
| 17052 | 9874 #endif /* emacs */ |
| 29184 | 9875 |
| 52401 | 9876 /* arch-tag: 3a3a2b01-5ff6-4071-9afe-f5b808d9229d |
| 9877 (do not change this comment) */ |
