Mercurial > emacs
annotate src/coding.c @ 89279:1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
the case that the last byte is '\r' correctly.
(decode_coding_emacs_mule): Likewise.
(decode_coding_iso_2022): Likewise.
(decode_coding_sjis): Likewise.
(decode_coding_big5): Likewise.
(decode_coding_charset): Likewise.
(produce_chars): Likewise.
(decode_coding): Flushing out the unprocessed data correctly.
(decode_coding_gap): Set CODING_MODE_LAST_BLOCK bit of
coding->mode.
| author | Kenichi Handa <handa@m17n.org> |
|---|---|
| date | Wed, 06 Nov 2002 00:10:42 +0000 |
| parents | 101ee928c088 |
| children | 1892a75ffcac |
| rev | line source |
|---|---|
| 88936 | 1 /* Coding system handler (conversion, detection, etc). |
| 20708 | 2 Copyright (C) 1995, 1997, 1998 Electrotechnical Laboratory, JAPAN. |
|
18269
888bfd80db2c
Change copyright notices.
Richard M. Stallman <rms@gnu.org>
parents:
18180
diff
changeset
|
3 Licensed to the Free Software Foundation. |
|
88862
108e2535280d
(adjust_coding_eol_type): Fix eol_type/eol_seen mixup.
Dave Love <fx@gnu.org>
parents:
88856
diff
changeset
|
4 Copyright (C) 2001, 2002 Free Software Foundation, Inc. |
| 88365 | 5 Copyright (C) 2001, 2002 |
| 6 National Institute of Advanced Industrial Science and Technology (AIST) | |
| 7 Registration Number H13PRO009 | |
| 17052 | 8 |
| 17071 | 9 This file is part of GNU Emacs. |
| 10 | |
| 11 GNU Emacs is free software; you can redistribute it and/or modify | |
| 12 it under the terms of the GNU General Public License as published by | |
| 13 the Free Software Foundation; either version 2, or (at your option) | |
| 14 any later version. | |
| 15 | |
| 16 GNU Emacs is distributed in the hope that it will be useful, | |
| 17 but WITHOUT ANY WARRANTY; without even the implied warranty of | |
| 18 MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the | |
| 19 GNU General Public License for more details. | |
| 20 | |
| 21 You should have received a copy of the GNU General Public License | |
| 22 along with GNU Emacs; see the file COPYING. If not, write to | |
| 23 the Free Software Foundation, Inc., 59 Temple Place - Suite 330, | |
| 24 Boston, MA 02111-1307, USA. */ | |
| 17052 | 25 |
| 26 /*** TABLE OF CONTENTS *** | |
| 27 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
28 0. General comments |
| 17052 | 29 1. Preamble |
| 88365 | 30 2. Emacs' internal format (emacs-utf-8) handlers |
| 31 3. UTF-8 handlers | |
| 32 4. UTF-16 handlers | |
| 33 5. Charset-base coding systems handlers | |
| 34 6. emacs-mule (old Emacs' internal format) handlers | |
| 35 7. ISO2022 handlers | |
| 36 8. Shift-JIS and BIG5 handlers | |
| 37 9. CCL handlers | |
| 38 10. C library functions | |
| 39 11. Emacs Lisp library functions | |
| 40 12. Postamble | |
| 17052 | 41 |
| 42 */ | |
| 43 | |
| 88365 | 44 /*** 0. General comments *** |
| 45 | |
| 46 | |
| 47 CODING SYSTEM | |
| 48 | |
| 88485 | 49 A coding system is an object for an encoding mechanism that contains |
| 50 information about how to convert byte sequences to character | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
51 sequences and vice versa. When we say "decode", it means converting |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
52 a byte sequence of a specific coding system into a character |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
53 sequence that is represented by Emacs' internal coding system |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
54 `emacs-utf-8', and when we say "encode", it means converting a |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
55 character sequence of emacs-utf-8 to a byte sequence of a specific |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
56 coding system. |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
57 |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
58 In Emacs Lisp, a coding system is represented by a Lisp symbol. In |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
59 C level, a coding system is represented by a vector of attributes |
| 88485 | 60 stored in the hash table Vcharset_hash_table. The conversion from |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
61 coding system symbol to attributes vector is done by looking up |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
62 Vcharset_hash_table by the symbol. |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
63 |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
64 Coding systems are classified into the following types depending on |
| 88485 | 65 the encoding mechanism. Here's a brief description of the types. |
| 88365 | 66 |
| 67 o UTF-8 | |
| 68 | |
| 69 o UTF-16 | |
| 70 | |
| 71 o Charset-base coding system | |
| 72 | |
| 73 A coding system defined by one or more (coded) character sets. | |
| 88485 | 74 Decoding and encoding are done by a code converter defined for each |
| 88365 | 75 character set. |
| 76 | |
| 88485 | 77 o Old Emacs internal format (emacs-mule) |
| 78 | |
| 79 The coding system adopted by old versions of Emacs (20 and 21). | |
| 88365 | 80 |
| 81 o ISO2022-base coding system | |
| 17052 | 82 |
| 83 The most famous coding system for multiple character sets. X's | |
| 88365 | 84 Compound Text, various EUCs (Extended Unix Code), and coding systems |
| 85 used in the Internet communication such as ISO-2022-JP are all | |
| 86 variants of ISO2022. | |
| 87 | |
| 88 o SJIS (or Shift-JIS or MS-Kanji-Code) | |
| 89 | |
| 17052 | 90 A coding system to encode character sets: ASCII, JISX0201, and |
| 91 JISX0208. Widely used for PC's in Japan. Details are described in | |
| 88365 | 92 section 8. |
| 93 | |
| 94 o BIG5 | |
| 95 | |
| 96 A coding system to encode character sets: ASCII and Big5. Widely | |
| 88771 | 97 used for Chinese (mainly in Taiwan and Hong Kong). Details are |
| 88365 | 98 described in section 8. In this file, when we write "big5" (all |
| 99 lowercase), we mean the coding system, and when we write "Big5" | |
| 100 (capitalized), we mean the character set. | |
| 101 | |
| 102 o CCL | |
| 103 | |
| 88485 | 104 If a user wants to decode/encode text encoded in a coding system |
| 88365 | 105 not listed above, he can supply a decoder and an encoder for it in |
| 106 CCL (Code Conversion Language) programs. Emacs executes the CCL | |
| 107 program while decoding/encoding. | |
| 108 | |
| 109 o Raw-text | |
| 110 | |
| 88771 | 111 A coding system for text containing raw eight-bit data. Emacs |
| 88485 | 112 treats each byte of source text as a character (except for |
| 88365 | 113 end-of-line conversion). |
| 114 | |
| 115 o No-conversion | |
| 116 | |
| 117 Like raw text, but don't do end-of-line conversion. | |
| 118 | |
| 119 | |
| 120 END-OF-LINE FORMAT | |
| 121 | |
| 88485 | 122 How text end-of-line is encoded depends on operating system. For |
| 88365 | 123 instance, Unix's format is just one byte of LF (line-feed) code, |
| 18766 | 124 whereas DOS's format is two-byte sequence of `carriage-return' and |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
125 `line-feed' codes. MacOS's format is usually one byte of |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
126 `carriage-return'. |
| 17052 | 127 |
| 88485 | 128 Since text character encoding and end-of-line encoding are |
| 88365 | 129 independent, any coding system described above can take any format |
| 130 of end-of-line (except for no-conversion). | |
| 17052 | 131 |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
132 STRUCT CODING_SYSTEM |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
133 |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
134 Before using a coding system for code conversion (i.e. decoding and |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
135 encoding), we setup a structure of type `struct coding_system'. |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
136 This structure keeps various information about a specific code |
| 88485 | 137 conversion (e.g. the location of source and destination data). |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
138 |
| 17052 | 139 */ |
| 140 | |
| 88365 | 141 /* COMMON MACROS */ |
| 142 | |
| 143 | |
| 17052 | 144 /*** GENERAL NOTES on `detect_coding_XXX ()' functions *** |
| 145 | |
| 88365 | 146 These functions check if a byte sequence specified as a source in |
| 147 CODING conforms to the format of XXX. Return 1 if the data contains | |
| 148 a byte sequence which can be decoded into non-ASCII characters by | |
| 149 the coding system. Otherwize (i.e. the data contains only ASCII | |
| 150 characters or invalid sequence) return 0. | |
| 151 | |
| 152 It also resets some bits of an integer pointed by MASK. The macros | |
| 153 CATEGORY_MASK_XXX specifies each bit of this integer. | |
| 154 | |
| 155 Below is the template of these functions. */ | |
| 156 | |
| 17052 | 157 #if 0 |
| 88365 | 158 static int |
| 159 detect_coding_XXX (coding, mask) | |
| 160 struct coding_system *coding; | |
| 161 int *mask; | |
| 17052 | 162 { |
| 88365 | 163 unsigned char *src = coding->source; |
| 164 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 165 int multibytep = coding->src_multibyte; | |
| 166 int c; | |
| 167 int found = 0; | |
| 168 ...; | |
| 169 | |
| 170 while (1) | |
| 171 { | |
| 172 /* Get one byte from the source. If the souce is exausted, jump | |
| 173 to no_more_source:. */ | |
| 174 ONE_MORE_BYTE (c); | |
| 175 /* Check if it conforms to XXX. If not, break the loop. */ | |
| 176 } | |
| 177 /* As the data is invalid for XXX, reset a proper bits. */ | |
| 178 *mask &= ~CODING_CATEGORY_XXX; | |
| 179 return 0; | |
| 180 no_more_source: | |
| 181 /* The source exausted. */ | |
| 182 if (!found) | |
| 183 /* ASCII characters only. */ | |
| 184 return 0; | |
| 185 /* Some data should be decoded into non-ASCII characters. */ | |
| 186 *mask &= CODING_CATEGORY_XXX; | |
| 187 return 1; | |
| 17052 | 188 } |
| 189 #endif | |
| 190 | |
| 191 /*** GENERAL NOTES on `decode_coding_XXX ()' functions *** | |
| 192 | |
| 88365 | 193 These functions decode a byte sequence specified as a source by |
| 194 CODING. The resulting multibyte text goes to a place pointed to by | |
| 195 CODING->charbuf, the length of which should not exceed | |
| 196 CODING->charbuf_size; | |
| 197 | |
| 198 These functions set the information of original and decoded texts in | |
| 199 CODING->consumed, CODING->consumed_char, and CODING->charbuf_used. | |
| 200 They also set CODING->result to one of CODING_RESULT_XXX indicating | |
| 201 how the decoding is finished. | |
| 202 | |
| 203 Below is the template of these functions. */ | |
| 204 | |
| 17052 | 205 #if 0 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
206 static void |
| 88365 | 207 decode_coding_XXXX (coding) |
| 17052 | 208 struct coding_system *coding; |
| 209 { | |
| 88365 | 210 unsigned char *src = coding->source + coding->consumed; |
| 211 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 212 /* SRC_BASE remembers the start position in source in each loop. | |
| 213 The loop will be exited when there's not enough source code, or | |
| 214 when there's no room in CHARBUF for a decoded character. */ | |
| 215 unsigned char *src_base; | |
| 216 /* A buffer to produce decoded characters. */ | |
| 217 int *charbuf = coding->charbuf; | |
| 218 int *charbuf_end = charbuf + coding->charbuf_size; | |
| 219 int multibytep = coding->src_multibyte; | |
| 220 | |
| 221 while (1) | |
| 222 { | |
| 223 src_base = src; | |
| 224 if (charbuf < charbuf_end) | |
| 225 /* No more room to produce a decoded character. */ | |
| 226 break; | |
| 227 ONE_MORE_BYTE (c); | |
| 228 /* Decode it. */ | |
| 229 } | |
| 230 | |
| 231 no_more_source: | |
| 232 if (src_base < src_end | |
| 233 && coding->mode & CODING_MODE_LAST_BLOCK) | |
| 234 /* If the source ends by partial bytes to construct a character, | |
| 235 treat them as eight-bit raw data. */ | |
| 236 while (src_base < src_end && charbuf < charbuf_end) | |
| 237 *charbuf++ = *src_base++; | |
| 238 /* Remember how many bytes and characters we consumed. If the | |
| 239 source is multibyte, the bytes and chars are not identical. */ | |
| 240 coding->consumed = coding->consumed_char = src_base - coding->source; | |
| 241 /* Remember how many characters we produced. */ | |
| 242 coding->charbuf_used = charbuf - coding->charbuf; | |
| 17052 | 243 } |
| 244 #endif | |
| 245 | |
| 246 /*** GENERAL NOTES on `encode_coding_XXX ()' functions *** | |
| 247 | |
| 88365 | 248 These functions encode SRC_BYTES length text at SOURCE of Emacs' |
| 249 internal multibyte format by CODING. The resulting byte sequence | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
250 goes to a place pointed to by DESTINATION, the length of which |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
251 should not exceed DST_BYTES. |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
252 |
| 88365 | 253 These functions set the information of original and encoded texts in |
| 254 the members produced, produced_char, consumed, and consumed_char of | |
| 255 the structure *CODING. They also set the member result to one of | |
| 256 CODING_RESULT_XXX indicating how the encoding finished. | |
| 257 | |
| 258 DST_BYTES zero means that source area and destination area are | |
| 259 overlapped, which means that we can produce a encoded text until it | |
| 260 reaches at the head of not-yet-encoded source text. | |
| 261 | |
| 262 Below is a template of these functions. */ | |
| 17052 | 263 #if 0 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
264 static void |
| 88365 | 265 encode_coding_XXX (coding) |
| 17052 | 266 struct coding_system *coding; |
| 267 { | |
| 88365 | 268 int multibytep = coding->dst_multibyte; |
| 269 int *charbuf = coding->charbuf; | |
| 270 int *charbuf_end = charbuf->charbuf + coding->charbuf_used; | |
| 271 unsigned char *dst = coding->destination + coding->produced; | |
| 272 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 273 unsigned char *adjusted_dst_end = dst_end - _MAX_BYTES_PRODUCED_IN_LOOP_; | |
| 274 int produced_chars = 0; | |
| 275 | |
| 276 for (; charbuf < charbuf_end && dst < adjusted_dst_end; charbuf++) | |
| 277 { | |
| 278 int c = *charbuf; | |
| 279 /* Encode C into DST, and increment DST. */ | |
| 280 } | |
| 281 label_no_more_destination: | |
| 282 /* How many chars and bytes we produced. */ | |
| 283 coding->produced_char += produced_chars; | |
| 284 coding->produced = dst - coding->destination; | |
| 17052 | 285 } |
| 286 #endif | |
| 287 | |
| 288 | |
| 289 /*** 1. Preamble ***/ | |
| 290 | |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
291 #include <config.h> |
| 17052 | 292 #include <stdio.h> |
| 293 | |
| 294 #include "lisp.h" | |
| 295 #include "buffer.h" | |
| 88365 | 296 #include "character.h" |
| 17052 | 297 #include "charset.h" |
| 88365 | 298 #include "ccl.h" |
| 26847 | 299 #include "composite.h" |
| 17052 | 300 #include "coding.h" |
| 301 #include "window.h" | |
| 302 | |
| 88365 | 303 Lisp_Object Vcoding_system_hash_table; |
| 304 | |
| 305 Lisp_Object Qcoding_system, Qcoding_aliases, Qeol_type; | |
|
88646
d3b1f30e2267
(Qmac): Remove (duplicated) definition.
Dave Love <fx@gnu.org>
parents:
88645
diff
changeset
|
306 Lisp_Object Qunix, Qdos; |
|
d3b1f30e2267
(Qmac): Remove (duplicated) definition.
Dave Love <fx@gnu.org>
parents:
88645
diff
changeset
|
307 extern Lisp_Object Qmac; /* frame.c */ |
| 17052 | 308 Lisp_Object Qbuffer_file_coding_system; |
| 309 Lisp_Object Qpost_read_conversion, Qpre_write_conversion; | |
| 88365 | 310 Lisp_Object Qdefault_char; |
|
19612
783efd6c7c1e
(Qno_conversion, Qundecided): New variables.
Kenichi Handa <handa@m17n.org>
parents:
19546
diff
changeset
|
311 Lisp_Object Qno_conversion, Qundecided; |
| 88365 | 312 Lisp_Object Qcharset, Qiso_2022, Qutf_8, Qutf_16, Qshift_jis, Qbig5; |
| 313 Lisp_Object Qutf_16_be_nosig, Qutf_16_be, Qutf_16_le_nosig, Qutf_16_le; | |
| 314 Lisp_Object Qsignature, Qendian, Qbig, Qlittle; | |
|
19750
95e4e1cba6ac
(Qcoding_system_history): New variable.
Richard M. Stallman <rms@gnu.org>
parents:
19747
diff
changeset
|
315 Lisp_Object Qcoding_system_history; |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
316 Lisp_Object Qvalid_codes; |
| 17052 | 317 |
| 318 extern Lisp_Object Qinsert_file_contents, Qwrite_region; | |
| 319 Lisp_Object Qcall_process, Qcall_process_region, Qprocess_argument; | |
| 320 Lisp_Object Qstart_process, Qopen_network_stream; | |
| 321 Lisp_Object Qtarget_idx; | |
| 322 | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
323 Lisp_Object Vselect_safe_coding_system_function; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
324 |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
325 /* Mnemonic string for each format of end-of-line. */ |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
326 Lisp_Object eol_mnemonic_unix, eol_mnemonic_dos, eol_mnemonic_mac; |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
327 /* Mnemonic string to indicate format of end-of-line is not yet |
| 17052 | 328 decided. */ |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
329 Lisp_Object eol_mnemonic_undecided; |
| 17052 | 330 |
| 331 #ifdef emacs | |
| 332 | |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
333 Lisp_Object Vcoding_system_list, Vcoding_system_alist; |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
334 |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
335 Lisp_Object Qcoding_system_p, Qcoding_system_error; |
| 17052 | 336 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
337 /* Coding system emacs-mule and raw-text are for converting only |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
338 end-of-line format. */ |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
339 Lisp_Object Qemacs_mule, Qraw_text; |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
340 |
| 17052 | 341 /* Coding-systems are handed between Emacs Lisp programs and C internal |
| 342 routines by the following three variables. */ | |
| 343 /* Coding-system for reading files and receiving data from process. */ | |
| 344 Lisp_Object Vcoding_system_for_read; | |
| 345 /* Coding-system for writing files and sending data to process. */ | |
| 346 Lisp_Object Vcoding_system_for_write; | |
| 347 /* Coding-system actually used in the latest I/O. */ | |
| 348 Lisp_Object Vlast_coding_system_used; | |
| 349 | |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
350 /* A vector of length 256 which contains information about special |
| 22529 | 351 Latin codes (especially for dealing with Microsoft codes). */ |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
352 Lisp_Object Vlatin_extra_code_table; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
353 |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
354 /* Flag to inhibit code conversion of end-of-line format. */ |
|
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
355 int inhibit_eol_conversion; |
|
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
356 |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
357 /* Flag to inhibit ISO2022 escape sequence detection. */ |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
358 int inhibit_iso_escape_detection; |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
359 |
|
21574
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
360 /* Flag to make buffer-file-coding-system inherit from process-coding. */ |
|
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
361 int inherit_process_coding_system; |
|
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
362 |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
363 /* Coding system to be used to encode text for terminal display. */ |
| 17052 | 364 struct coding_system terminal_coding; |
| 365 | |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
366 /* Coding system to be used to encode text for terminal display when |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
367 terminal coding system is nil. */ |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
368 struct coding_system safe_terminal_coding; |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
369 |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
370 /* Coding system of what is sent from terminal keyboard. */ |
| 17052 | 371 struct coding_system keyboard_coding; |
| 372 | |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
373 Lisp_Object Vfile_coding_system_alist; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
374 Lisp_Object Vprocess_coding_system_alist; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
375 Lisp_Object Vnetwork_coding_system_alist; |
| 17052 | 376 |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
377 Lisp_Object Vlocale_coding_system; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
378 |
| 17052 | 379 #endif /* emacs */ |
| 380 | |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
381 /* Flag to tell if we look up translation table on character code |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
382 conversion. */ |
|
22119
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
383 Lisp_Object Venable_character_translation; |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
384 /* Standard translation table to look up on decoding (reading). */ |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
385 Lisp_Object Vstandard_translation_table_for_decode; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
386 /* Standard translation table to look up on encoding (writing). */ |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
387 Lisp_Object Vstandard_translation_table_for_encode; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
388 |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
389 Lisp_Object Qtranslation_table; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
390 Lisp_Object Qtranslation_table_id; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
391 Lisp_Object Qtranslation_table_for_decode; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
392 Lisp_Object Qtranslation_table_for_encode; |
| 17052 | 393 |
| 394 /* Alist of charsets vs revision number. */ | |
| 88365 | 395 static Lisp_Object Vcharset_revision_table; |
| 17052 | 396 |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
397 /* Default coding systems used for process I/O. */ |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
398 Lisp_Object Vdefault_process_coding_system; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
399 |
|
26067
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
400 /* Global flag to tell that we can't call post-read-conversion and |
|
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
401 pre-write-conversion functions. Usually the value is zero, but it |
|
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
402 is set to 1 temporarily while such functions are running. This is |
|
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
403 to avoid infinite recursive call. */ |
|
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
404 static int inhibit_pre_post_conversion; |
|
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
405 |
| 88365 | 406 /* Two special coding systems. */ |
| 407 Lisp_Object Vsjis_coding_system; | |
| 408 Lisp_Object Vbig5_coding_system; | |
| 409 | |
| 410 | |
| 411 static int detect_coding_utf_8 P_ ((struct coding_system *, int *)); | |
| 412 static void decode_coding_utf_8 P_ ((struct coding_system *)); | |
| 413 static int encode_coding_utf_8 P_ ((struct coding_system *)); | |
| 414 | |
| 415 static int detect_coding_utf_16 P_ ((struct coding_system *, int *)); | |
| 416 static void decode_coding_utf_16 P_ ((struct coding_system *)); | |
| 417 static int encode_coding_utf_16 P_ ((struct coding_system *)); | |
| 418 | |
| 419 static int detect_coding_iso_2022 P_ ((struct coding_system *, int *)); | |
| 420 static void decode_coding_iso_2022 P_ ((struct coding_system *)); | |
| 421 static int encode_coding_iso_2022 P_ ((struct coding_system *)); | |
| 422 | |
| 423 static int detect_coding_emacs_mule P_ ((struct coding_system *, int *)); | |
| 424 static void decode_coding_emacs_mule P_ ((struct coding_system *)); | |
| 425 static int encode_coding_emacs_mule P_ ((struct coding_system *)); | |
| 426 | |
| 427 static int detect_coding_sjis P_ ((struct coding_system *, int *)); | |
| 428 static void decode_coding_sjis P_ ((struct coding_system *)); | |
| 429 static int encode_coding_sjis P_ ((struct coding_system *)); | |
| 430 | |
| 431 static int detect_coding_big5 P_ ((struct coding_system *, int *)); | |
| 432 static void decode_coding_big5 P_ ((struct coding_system *)); | |
| 433 static int encode_coding_big5 P_ ((struct coding_system *)); | |
| 434 | |
| 435 static int detect_coding_ccl P_ ((struct coding_system *, int *)); | |
| 436 static void decode_coding_ccl P_ ((struct coding_system *)); | |
| 437 static int encode_coding_ccl P_ ((struct coding_system *)); | |
| 438 | |
| 439 static void decode_coding_raw_text P_ ((struct coding_system *)); | |
| 440 static int encode_coding_raw_text P_ ((struct coding_system *)); | |
| 441 | |
| 442 | |
| 443 /* ISO2022 section */ | |
| 444 | |
| 445 #define CODING_ISO_INITIAL(coding, reg) \ | |
| 446 (XINT (AREF (AREF (CODING_ID_ATTRS ((coding)->id), \ | |
| 447 coding_attr_iso_initial), \ | |
| 448 reg))) | |
| 449 | |
| 450 | |
| 451 #define CODING_ISO_REQUEST(coding, charset_id) \ | |
| 452 ((charset_id <= (coding)->max_charset_id \ | |
| 453 ? (coding)->safe_charsets[charset_id] \ | |
| 454 : -1)) | |
| 455 | |
| 456 | |
| 457 #define CODING_ISO_FLAGS(coding) \ | |
| 458 ((coding)->spec.iso_2022.flags) | |
| 459 #define CODING_ISO_DESIGNATION(coding, reg) \ | |
| 460 ((coding)->spec.iso_2022.current_designation[reg]) | |
| 461 #define CODING_ISO_INVOCATION(coding, plane) \ | |
| 462 ((coding)->spec.iso_2022.current_invocation[plane]) | |
| 463 #define CODING_ISO_SINGLE_SHIFTING(coding) \ | |
| 464 ((coding)->spec.iso_2022.single_shifting) | |
| 465 #define CODING_ISO_BOL(coding) \ | |
| 466 ((coding)->spec.iso_2022.bol) | |
| 467 #define CODING_ISO_INVOKED_CHARSET(coding, plane) \ | |
| 468 CODING_ISO_DESIGNATION ((coding), CODING_ISO_INVOCATION ((coding), (plane))) | |
| 469 | |
| 470 /* Control characters of ISO2022. */ | |
| 471 /* code */ /* function */ | |
| 472 #define ISO_CODE_LF 0x0A /* line-feed */ | |
| 473 #define ISO_CODE_CR 0x0D /* carriage-return */ | |
| 474 #define ISO_CODE_SO 0x0E /* shift-out */ | |
| 475 #define ISO_CODE_SI 0x0F /* shift-in */ | |
| 476 #define ISO_CODE_SS2_7 0x19 /* single-shift-2 for 7-bit code */ | |
| 477 #define ISO_CODE_ESC 0x1B /* escape */ | |
| 478 #define ISO_CODE_SS2 0x8E /* single-shift-2 */ | |
| 479 #define ISO_CODE_SS3 0x8F /* single-shift-3 */ | |
| 480 #define ISO_CODE_CSI 0x9B /* control-sequence-introducer */ | |
| 481 | |
| 482 /* All code (1-byte) of ISO2022 is classified into one of the | |
| 483 followings. */ | |
| 484 enum iso_code_class_type | |
| 485 { | |
| 486 ISO_control_0, /* Control codes in the range | |
| 487 0x00..0x1F and 0x7F, except for the | |
| 488 following 5 codes. */ | |
| 489 ISO_carriage_return, /* ISO_CODE_CR (0x0D) */ | |
| 490 ISO_shift_out, /* ISO_CODE_SO (0x0E) */ | |
| 491 ISO_shift_in, /* ISO_CODE_SI (0x0F) */ | |
| 492 ISO_single_shift_2_7, /* ISO_CODE_SS2_7 (0x19) */ | |
| 493 ISO_escape, /* ISO_CODE_SO (0x1B) */ | |
| 494 ISO_control_1, /* Control codes in the range | |
| 495 0x80..0x9F, except for the | |
| 496 following 3 codes. */ | |
| 497 ISO_single_shift_2, /* ISO_CODE_SS2 (0x8E) */ | |
| 498 ISO_single_shift_3, /* ISO_CODE_SS3 (0x8F) */ | |
| 499 ISO_control_sequence_introducer, /* ISO_CODE_CSI (0x9B) */ | |
| 500 ISO_0x20_or_0x7F, /* Codes of the values 0x20 or 0x7F. */ | |
| 501 ISO_graphic_plane_0, /* Graphic codes in the range 0x21..0x7E. */ | |
| 502 ISO_0xA0_or_0xFF, /* Codes of the values 0xA0 or 0xFF. */ | |
| 503 ISO_graphic_plane_1 /* Graphic codes in the range 0xA1..0xFE. */ | |
| 504 }; | |
| 505 | |
| 506 /** The macros CODING_ISO_FLAG_XXX defines a flag bit of the | |
| 507 `iso-flags' attribute of an iso2022 coding system. */ | |
| 508 | |
| 509 /* If set, produce long-form designation sequence (e.g. ESC $ ( A) | |
| 510 instead of the correct short-form sequence (e.g. ESC $ A). */ | |
| 511 #define CODING_ISO_FLAG_LONG_FORM 0x0001 | |
| 512 | |
| 513 /* If set, reset graphic planes and registers at end-of-line to the | |
| 514 initial state. */ | |
| 515 #define CODING_ISO_FLAG_RESET_AT_EOL 0x0002 | |
| 516 | |
| 517 /* If set, reset graphic planes and registers before any control | |
| 518 characters to the initial state. */ | |
| 519 #define CODING_ISO_FLAG_RESET_AT_CNTL 0x0004 | |
| 520 | |
| 521 /* If set, encode by 7-bit environment. */ | |
| 522 #define CODING_ISO_FLAG_SEVEN_BITS 0x0008 | |
| 523 | |
| 524 /* If set, use locking-shift function. */ | |
| 525 #define CODING_ISO_FLAG_LOCKING_SHIFT 0x0010 | |
| 526 | |
| 527 /* If set, use single-shift function. Overwrite | |
| 528 CODING_ISO_FLAG_LOCKING_SHIFT. */ | |
| 529 #define CODING_ISO_FLAG_SINGLE_SHIFT 0x0020 | |
| 530 | |
| 531 /* If set, use designation escape sequence. */ | |
| 532 #define CODING_ISO_FLAG_DESIGNATION 0x0040 | |
| 533 | |
| 534 /* If set, produce revision number sequence. */ | |
| 535 #define CODING_ISO_FLAG_REVISION 0x0080 | |
| 536 | |
| 537 /* If set, produce ISO6429's direction specifying sequence. */ | |
| 538 #define CODING_ISO_FLAG_DIRECTION 0x0100 | |
| 539 | |
| 540 /* If set, assume designation states are reset at beginning of line on | |
| 541 output. */ | |
| 542 #define CODING_ISO_FLAG_INIT_AT_BOL 0x0200 | |
| 543 | |
| 544 /* If set, designation sequence should be placed at beginning of line | |
| 545 on output. */ | |
| 546 #define CODING_ISO_FLAG_DESIGNATE_AT_BOL 0x0400 | |
| 547 | |
| 548 /* If set, do not encode unsafe charactes on output. */ | |
| 549 #define CODING_ISO_FLAG_SAFE 0x0800 | |
| 550 | |
| 551 /* If set, extra latin codes (128..159) are accepted as a valid code | |
| 552 on input. */ | |
| 553 #define CODING_ISO_FLAG_LATIN_EXTRA 0x1000 | |
| 554 | |
| 555 #define CODING_ISO_FLAG_COMPOSITION 0x2000 | |
| 556 | |
| 557 #define CODING_ISO_FLAG_EUC_TW_SHIFT 0x4000 | |
| 558 | |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
559 #define CODING_ISO_FLAG_USE_ROMAN 0x8000 |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
560 |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
561 #define CODING_ISO_FLAG_USE_OLDJIS 0x10000 |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
562 |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
563 #define CODING_ISO_FLAG_FULL_SUPPORT 0x100000 |
| 88365 | 564 |
| 565 /* A character to be produced on output if encoding of the original | |
| 566 character is prohibited by CODING_ISO_FLAG_SAFE. */ | |
| 567 #define CODING_INHIBIT_CHARACTER_SUBSTITUTION '?' | |
| 568 | |
| 569 | |
| 570 /* UTF-16 section */ | |
| 571 #define CODING_UTF_16_BOM(coding) \ | |
| 572 ((coding)->spec.utf_16.bom) | |
| 573 | |
| 574 #define CODING_UTF_16_ENDIAN(coding) \ | |
| 575 ((coding)->spec.utf_16.endian) | |
| 576 | |
| 577 #define CODING_UTF_16_SURROGATE(coding) \ | |
| 578 ((coding)->spec.utf_16.surrogate) | |
| 579 | |
| 580 | |
| 581 /* CCL section */ | |
| 582 #define CODING_CCL_DECODER(coding) \ | |
| 583 AREF (CODING_ID_ATTRS ((coding)->id), coding_attr_ccl_decoder) | |
| 584 #define CODING_CCL_ENCODER(coding) \ | |
| 585 AREF (CODING_ID_ATTRS ((coding)->id), coding_attr_ccl_encoder) | |
| 586 #define CODING_CCL_VALIDS(coding) \ | |
| 587 (XSTRING (AREF (CODING_ID_ATTRS ((coding)->id), coding_attr_ccl_valids)) \ | |
| 588 ->data) | |
| 589 | |
| 88771 | 590 /* Index for each coding category in `coding_categories' */ |
| 88365 | 591 |
| 592 enum coding_category | |
| 593 { | |
| 594 coding_category_iso_7, | |
| 595 coding_category_iso_7_tight, | |
| 596 coding_category_iso_8_1, | |
| 597 coding_category_iso_8_2, | |
| 598 coding_category_iso_7_else, | |
| 599 coding_category_iso_8_else, | |
| 600 coding_category_utf_8, | |
| 601 coding_category_utf_16_auto, | |
| 602 coding_category_utf_16_be, | |
| 603 coding_category_utf_16_le, | |
| 604 coding_category_utf_16_be_nosig, | |
| 605 coding_category_utf_16_le_nosig, | |
| 606 coding_category_charset, | |
| 607 coding_category_sjis, | |
| 608 coding_category_big5, | |
| 609 coding_category_ccl, | |
| 610 coding_category_emacs_mule, | |
| 611 /* All above are targets of code detection. */ | |
| 612 coding_category_raw_text, | |
| 613 coding_category_undecided, | |
| 614 coding_category_max | |
| 615 }; | |
| 616 | |
| 617 /* Definitions of flag bits used in detect_coding_XXXX. */ | |
| 618 #define CATEGORY_MASK_ISO_7 (1 << coding_category_iso_7) | |
| 619 #define CATEGORY_MASK_ISO_7_TIGHT (1 << coding_category_iso_7_tight) | |
| 620 #define CATEGORY_MASK_ISO_8_1 (1 << coding_category_iso_8_1) | |
| 621 #define CATEGORY_MASK_ISO_8_2 (1 << coding_category_iso_8_2) | |
| 622 #define CATEGORY_MASK_ISO_7_ELSE (1 << coding_category_iso_7_else) | |
| 623 #define CATEGORY_MASK_ISO_8_ELSE (1 << coding_category_iso_8_else) | |
| 624 #define CATEGORY_MASK_UTF_8 (1 << coding_category_utf_8) | |
| 625 #define CATEGORY_MASK_UTF_16_BE (1 << coding_category_utf_16_be) | |
| 626 #define CATEGORY_MASK_UTF_16_LE (1 << coding_category_utf_16_le) | |
| 627 #define CATEGORY_MASK_UTF_16_BE_NOSIG (1 << coding_category_utf_16_be_nosig) | |
| 628 #define CATEGORY_MASK_UTF_16_LE_NOSIG (1 << coding_category_utf_16_le_nosig) | |
| 629 #define CATEGORY_MASK_CHARSET (1 << coding_category_charset) | |
| 630 #define CATEGORY_MASK_SJIS (1 << coding_category_sjis) | |
| 631 #define CATEGORY_MASK_BIG5 (1 << coding_category_big5) | |
| 632 #define CATEGORY_MASK_CCL (1 << coding_category_ccl) | |
| 633 #define CATEGORY_MASK_EMACS_MULE (1 << coding_category_emacs_mule) | |
| 634 | |
| 635 /* This value is returned if detect_coding_mask () find nothing other | |
| 636 than ASCII characters. */ | |
| 637 #define CATEGORY_MASK_ANY \ | |
| 638 (CATEGORY_MASK_ISO_7 \ | |
| 639 | CATEGORY_MASK_ISO_7_TIGHT \ | |
| 640 | CATEGORY_MASK_ISO_8_1 \ | |
| 641 | CATEGORY_MASK_ISO_8_2 \ | |
| 642 | CATEGORY_MASK_ISO_7_ELSE \ | |
| 643 | CATEGORY_MASK_ISO_8_ELSE \ | |
| 644 | CATEGORY_MASK_UTF_8 \ | |
| 645 | CATEGORY_MASK_UTF_16_BE \ | |
| 646 | CATEGORY_MASK_UTF_16_LE \ | |
| 647 | CATEGORY_MASK_UTF_16_BE_NOSIG \ | |
| 648 | CATEGORY_MASK_UTF_16_LE_NOSIG \ | |
| 649 | CATEGORY_MASK_CHARSET \ | |
| 650 | CATEGORY_MASK_SJIS \ | |
| 651 | CATEGORY_MASK_BIG5 \ | |
| 652 | CATEGORY_MASK_CCL \ | |
| 653 | CATEGORY_MASK_EMACS_MULE) | |
| 654 | |
| 655 | |
| 656 #define CATEGORY_MASK_ISO_7BIT \ | |
| 657 (CATEGORY_MASK_ISO_7 | CATEGORY_MASK_ISO_7_TIGHT) | |
| 658 | |
| 659 #define CATEGORY_MASK_ISO_8BIT \ | |
| 660 (CATEGORY_MASK_ISO_8_1 | CATEGORY_MASK_ISO_8_2) | |
| 661 | |
| 662 #define CATEGORY_MASK_ISO_ELSE \ | |
| 663 (CATEGORY_MASK_ISO_7_ELSE | CATEGORY_MASK_ISO_8_ELSE) | |
| 664 | |
| 665 #define CATEGORY_MASK_ISO_ESCAPE \ | |
| 666 (CATEGORY_MASK_ISO_7 \ | |
| 667 | CATEGORY_MASK_ISO_7_TIGHT \ | |
| 668 | CATEGORY_MASK_ISO_7_ELSE \ | |
| 669 | CATEGORY_MASK_ISO_8_ELSE) | |
| 670 | |
| 671 #define CATEGORY_MASK_ISO \ | |
| 672 ( CATEGORY_MASK_ISO_7BIT \ | |
| 673 | CATEGORY_MASK_ISO_8BIT \ | |
| 674 | CATEGORY_MASK_ISO_ELSE) | |
| 675 | |
| 676 #define CATEGORY_MASK_UTF_16 \ | |
| 677 (CATEGORY_MASK_UTF_16_BE \ | |
| 678 | CATEGORY_MASK_UTF_16_LE \ | |
| 679 | CATEGORY_MASK_UTF_16_BE_NOSIG \ | |
| 680 | CATEGORY_MASK_UTF_16_LE_NOSIG) | |
| 681 | |
| 682 | |
| 683 /* List of symbols `coding-category-xxx' ordered by priority. This | |
| 684 variable is exposed to Emacs Lisp. */ | |
| 685 static Lisp_Object Vcoding_category_list; | |
| 686 | |
| 687 /* Table of coding categories (Lisp symbols). This variable is for | |
| 688 internal use oly. */ | |
| 689 static Lisp_Object Vcoding_category_table; | |
| 690 | |
| 691 /* Table of coding-categories ordered by priority. */ | |
| 692 static enum coding_category coding_priorities[coding_category_max]; | |
| 693 | |
| 694 /* Nth element is a coding context for the coding system bound to the | |
| 695 Nth coding category. */ | |
| 696 static struct coding_system coding_categories[coding_category_max]; | |
| 697 | |
| 698 static int detected_mask[coding_category_raw_text] = | |
| 699 { CATEGORY_MASK_ISO, | |
| 700 CATEGORY_MASK_ISO, | |
| 701 CATEGORY_MASK_ISO, | |
| 702 CATEGORY_MASK_ISO, | |
| 703 CATEGORY_MASK_ISO, | |
| 704 CATEGORY_MASK_ISO, | |
| 705 CATEGORY_MASK_UTF_8, | |
| 706 CATEGORY_MASK_UTF_16, | |
| 707 CATEGORY_MASK_UTF_16, | |
| 708 CATEGORY_MASK_UTF_16, | |
| 709 CATEGORY_MASK_UTF_16, | |
| 710 CATEGORY_MASK_UTF_16, | |
| 711 CATEGORY_MASK_CHARSET, | |
| 712 CATEGORY_MASK_SJIS, | |
| 713 CATEGORY_MASK_BIG5, | |
| 714 CATEGORY_MASK_CCL, | |
| 715 CATEGORY_MASK_EMACS_MULE | |
| 716 }; | |
| 717 | |
| 718 /*** Commonly used macros and functions ***/ | |
| 719 | |
| 720 #ifndef min | |
| 721 #define min(a, b) ((a) < (b) ? (a) : (b)) | |
| 722 #endif | |
| 723 #ifndef max | |
| 724 #define max(a, b) ((a) > (b) ? (a) : (b)) | |
| 725 #endif | |
| 726 | |
| 727 #define CODING_GET_INFO(coding, attrs, eol_type, charset_list) \ | |
| 728 do { \ | |
| 729 attrs = CODING_ID_ATTRS (coding->id); \ | |
| 730 eol_type = CODING_ID_EOL_TYPE (coding->id); \ | |
| 731 if (VECTORP (eol_type)) \ | |
| 732 eol_type = Qunix; \ | |
| 733 charset_list = CODING_ATTR_CHARSET_LIST (attrs); \ | |
| 734 } while (0) | |
| 735 | |
| 736 | |
| 737 /* Safely get one byte from the source text pointed by SRC which ends | |
| 738 at SRC_END, and set C to that byte. If there are not enough bytes | |
| 739 in the source, it jumps to `no_more_source'. The caller | |
| 740 should declare and set these variables appropriately in advance: | |
| 741 src, src_end, multibytep | |
| 742 */ | |
| 743 | |
| 744 #define ONE_MORE_BYTE(c) \ | |
| 745 do { \ | |
| 746 if (src == src_end) \ | |
| 747 { \ | |
| 748 if (src_base < src) \ | |
| 749 coding->result = CODING_RESULT_INSUFFICIENT_SRC; \ | |
| 750 goto no_more_source; \ | |
| 751 } \ | |
| 752 c = *src++; \ | |
| 753 if (multibytep && (c & 0x80)) \ | |
| 754 { \ | |
| 755 if ((c & 0xFE) != 0xC0) \ | |
| 756 error ("Undecodable char found"); \ | |
| 757 c = ((c & 1) << 6) | *src++; \ | |
| 758 } \ | |
| 759 consumed_chars++; \ | |
| 760 } while (0) | |
| 761 | |
| 762 | |
| 763 #define ONE_MORE_BYTE_NO_CHECK(c) \ | |
| 764 do { \ | |
| 765 c = *src++; \ | |
| 766 if (multibytep && (c & 0x80)) \ | |
| 767 { \ | |
| 768 if ((c & 0xFE) != 0xC0) \ | |
| 769 error ("Undecodable char found"); \ | |
| 770 c = ((c & 1) << 6) | *src++; \ | |
| 771 } \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
772 consumed_chars++; \ |
| 88365 | 773 } while (0) |
| 774 | |
| 775 | |
| 776 /* Store a byte C in the place pointed by DST and increment DST to the | |
| 777 next free point, and increment PRODUCED_CHARS. The caller should | |
| 778 assure that C is 0..127, and declare and set the variable `dst' | |
| 779 appropriately in advance. | |
| 780 */ | |
| 781 | |
| 782 | |
| 783 #define EMIT_ONE_ASCII_BYTE(c) \ | |
| 784 do { \ | |
| 785 produced_chars++; \ | |
| 786 *dst++ = (c); \ | |
| 787 } while (0) | |
| 788 | |
| 789 | |
| 790 /* Like EMIT_ONE_ASCII_BYTE byt store two bytes; C1 and C2. */ | |
| 791 | |
| 792 #define EMIT_TWO_ASCII_BYTES(c1, c2) \ | |
| 793 do { \ | |
| 794 produced_chars += 2; \ | |
| 795 *dst++ = (c1), *dst++ = (c2); \ | |
| 796 } while (0) | |
| 797 | |
| 798 | |
| 799 /* Store a byte C in the place pointed by DST and increment DST to the | |
| 800 next free point, and increment PRODUCED_CHARS. If MULTIBYTEP is | |
| 801 nonzero, store in an appropriate multibyte from. The caller should | |
| 802 declare and set the variables `dst' and `multibytep' appropriately | |
| 803 in advance. */ | |
| 804 | |
| 805 #define EMIT_ONE_BYTE(c) \ | |
| 806 do { \ | |
| 807 produced_chars++; \ | |
| 808 if (multibytep) \ | |
| 809 { \ | |
| 810 int ch = (c); \ | |
| 811 if (ch >= 0x80) \ | |
| 812 ch = BYTE8_TO_CHAR (ch); \ | |
| 813 CHAR_STRING_ADVANCE (ch, dst); \ | |
| 814 } \ | |
| 815 else \ | |
| 816 *dst++ = (c); \ | |
| 817 } while (0) | |
| 818 | |
| 819 | |
| 820 /* Like EMIT_ONE_BYTE, but emit two bytes; C1 and C2. */ | |
| 821 | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
822 #define EMIT_TWO_BYTES(c1, c2) \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
823 do { \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
824 produced_chars += 2; \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
825 if (multibytep) \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
826 { \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
827 int ch; \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
828 \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
829 ch = (c1); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
830 if (ch >= 0x80) \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
831 ch = BYTE8_TO_CHAR (ch); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
832 CHAR_STRING_ADVANCE (ch, dst); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
833 ch = (c2); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
834 if (ch >= 0x80) \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
835 ch = BYTE8_TO_CHAR (ch); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
836 CHAR_STRING_ADVANCE (ch, dst); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
837 } \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
838 else \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
839 { \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
840 *dst++ = (c1); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
841 *dst++ = (c2); \ |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
842 } \ |
| 88365 | 843 } while (0) |
| 844 | |
| 845 | |
| 846 #define EMIT_THREE_BYTES(c1, c2, c3) \ | |
| 847 do { \ | |
| 848 EMIT_ONE_BYTE (c1); \ | |
| 849 EMIT_TWO_BYTES (c2, c3); \ | |
| 850 } while (0) | |
| 851 | |
| 852 | |
| 853 #define EMIT_FOUR_BYTES(c1, c2, c3, c4) \ | |
| 854 do { \ | |
| 855 EMIT_TWO_BYTES (c1, c2); \ | |
| 856 EMIT_TWO_BYTES (c3, c4); \ | |
| 857 } while (0) | |
| 858 | |
| 859 | |
| 860 #define CODING_DECODE_CHAR(coding, src, src_base, src_end, charset, code, c) \ | |
| 861 do { \ | |
| 862 charset_map_loaded = 0; \ | |
| 863 c = DECODE_CHAR (charset, code); \ | |
| 864 if (charset_map_loaded) \ | |
| 865 { \ | |
| 866 unsigned char *orig = coding->source; \ | |
| 867 EMACS_INT offset; \ | |
| 868 \ | |
| 869 coding_set_source (coding); \ | |
| 870 offset = coding->source - orig; \ | |
| 871 src += offset; \ | |
| 872 src_base += offset; \ | |
| 873 src_end += offset; \ | |
| 874 } \ | |
| 875 } while (0) | |
| 876 | |
| 877 | |
| 878 #define ASSURE_DESTINATION(bytes) \ | |
| 879 do { \ | |
| 880 if (dst + (bytes) >= dst_end) \ | |
| 881 { \ | |
| 882 int more_bytes = charbuf_end - charbuf + (bytes); \ | |
| 883 \ | |
| 884 dst = alloc_destination (coding, more_bytes, dst); \ | |
| 885 dst_end = coding->destination + coding->dst_bytes; \ | |
| 886 } \ | |
| 887 } while (0) | |
| 888 | |
| 889 | |
| 890 | |
| 891 static void | |
| 892 coding_set_source (coding) | |
| 893 struct coding_system *coding; | |
| 894 { | |
| 895 if (BUFFERP (coding->src_object)) | |
| 896 { | |
| 897 if (coding->src_pos < 0) | |
| 898 coding->source = GAP_END_ADDR + coding->src_pos_byte; | |
| 899 else | |
| 900 { | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
901 struct buffer *buf = XBUFFER (coding->src_object); |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
902 EMACS_INT gpt_byte = BUF_GPT_BYTE (buf); |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
903 unsigned char *beg_addr = BUF_BEG_ADDR (buf); |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
904 |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
905 coding->source = beg_addr + coding->src_pos_byte - 1; |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
906 if (coding->src_pos_byte >= gpt_byte) |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
907 coding->source += BUF_GAP_SIZE (buf); |
| 88365 | 908 } |
| 909 } | |
| 910 else if (STRINGP (coding->src_object)) | |
| 911 { | |
| 912 coding->source = (XSTRING (coding->src_object)->data | |
| 913 + coding->src_pos_byte); | |
| 914 } | |
| 915 else | |
| 916 /* Otherwise, the source is C string and is never relocated | |
| 917 automatically. Thus we don't have to update anything. */ | |
| 918 ; | |
| 919 } | |
| 920 | |
| 921 static void | |
| 922 coding_set_destination (coding) | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
923 struct coding_system *coding; |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
924 { |
| 88365 | 925 if (BUFFERP (coding->dst_object)) |
| 926 { | |
| 927 if (coding->src_pos < 0) | |
|
89042
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
928 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
929 coding->destination = BEG_ADDR + coding->dst_pos_byte - 1; |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
930 coding->dst_bytes = (GAP_END_ADDR |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
931 - (coding->src_bytes - coding->consumed) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
932 - coding->destination); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
933 } |
| 88365 | 934 else |
|
89042
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
935 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
936 /* We are sure that coding->dst_pos_byte is before the gap |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
937 of the buffer. */ |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
938 coding->destination = (BUF_BEG_ADDR (XBUFFER (coding->dst_object)) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
939 + coding->dst_pos_byte - 1); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
940 coding->dst_bytes = (BUF_GAP_END_ADDR (XBUFFER (coding->dst_object)) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
941 - coding->destination); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
942 } |
| 88365 | 943 } |
| 944 else | |
| 945 /* Otherwise, the destination is C string and is never relocated | |
| 946 automatically. Thus we don't have to update anything. */ | |
| 947 ; | |
| 948 } | |
| 949 | |
| 950 | |
| 951 static void | |
| 952 coding_alloc_by_realloc (coding, bytes) | |
| 953 struct coding_system *coding; | |
| 954 EMACS_INT bytes; | |
| 955 { | |
| 956 coding->destination = (unsigned char *) xrealloc (coding->destination, | |
| 957 coding->dst_bytes + bytes); | |
| 958 coding->dst_bytes += bytes; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
959 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
960 |
| 88365 | 961 static void |
| 962 coding_alloc_by_making_gap (coding, bytes) | |
| 963 struct coding_system *coding; | |
| 964 EMACS_INT bytes; | |
| 965 { | |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
966 if (BUFFERP (coding->dst_object) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
967 && EQ (coding->src_object, coding->dst_object)) |
| 88365 | 968 { |
| 969 EMACS_INT add = coding->src_bytes - coding->consumed; | |
| 970 | |
| 971 GAP_SIZE -= add; ZV += add; Z += add; ZV_BYTE += add; Z_BYTE += add; | |
| 972 make_gap (bytes); | |
| 973 GAP_SIZE += add; ZV -= add; Z -= add; ZV_BYTE -= add; Z_BYTE -= add; | |
| 974 } | |
| 975 else | |
| 976 { | |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
977 Lisp_Object this_buffer; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
978 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
979 this_buffer = Fcurrent_buffer (); |
| 88365 | 980 set_buffer_internal (XBUFFER (coding->dst_object)); |
| 981 make_gap (bytes); | |
| 982 set_buffer_internal (XBUFFER (this_buffer)); | |
| 983 } | |
| 984 } | |
| 985 | |
| 986 | |
| 987 static unsigned char * | |
| 988 alloc_destination (coding, nbytes, dst) | |
| 989 struct coding_system *coding; | |
| 990 int nbytes; | |
| 991 unsigned char *dst; | |
| 992 { | |
| 993 EMACS_INT offset = dst - coding->destination; | |
| 994 | |
| 995 if (BUFFERP (coding->dst_object)) | |
| 996 coding_alloc_by_making_gap (coding, nbytes); | |
| 997 else | |
| 998 coding_alloc_by_realloc (coding, nbytes); | |
| 999 coding->result = CODING_RESULT_SUCCESS; | |
| 1000 coding_set_destination (coding); | |
| 1001 dst = coding->destination + offset; | |
| 1002 return dst; | |
| 1003 } | |
| 1004 | |
| 1005 | |
| 1006 /*** 2. Emacs' internal format (emacs-utf-8) ***/ | |
| 1007 | |
| 1008 | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
1009 |
| 17052 | 1010 |
| 88365 | 1011 /*** 3. UTF-8 ***/ |
| 1012 | |
| 1013 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
| 1014 Check if a text is encoded in UTF-8. If it is, return | |
| 1015 CATEGORY_MASK_UTF_8, else return 0. */ | |
| 1016 | |
| 1017 #define UTF_8_1_OCTET_P(c) ((c) < 0x80) | |
| 1018 #define UTF_8_EXTRA_OCTET_P(c) (((c) & 0xC0) == 0x80) | |
| 1019 #define UTF_8_2_OCTET_LEADING_P(c) (((c) & 0xE0) == 0xC0) | |
| 1020 #define UTF_8_3_OCTET_LEADING_P(c) (((c) & 0xF0) == 0xE0) | |
| 1021 #define UTF_8_4_OCTET_LEADING_P(c) (((c) & 0xF8) == 0xF0) | |
| 1022 #define UTF_8_5_OCTET_LEADING_P(c) (((c) & 0xFC) == 0xF8) | |
| 1023 | |
| 1024 static int | |
| 1025 detect_coding_utf_8 (coding, mask) | |
| 1026 struct coding_system *coding; | |
| 1027 int *mask; | |
| 1028 { | |
| 1029 unsigned char *src = coding->source, *src_base = src; | |
| 1030 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 1031 int multibytep = coding->src_multibyte; | |
| 1032 int consumed_chars = 0; | |
| 1033 int found = 0; | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1034 int incomplete; |
| 88365 | 1035 |
| 1036 /* A coding system of this category is always ASCII compatible. */ | |
| 1037 src += coding->head_ascii; | |
| 1038 | |
| 1039 while (1) | |
| 1040 { | |
| 1041 int c, c1, c2, c3, c4; | |
| 1042 | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1043 incomplete = 0; |
| 88365 | 1044 ONE_MORE_BYTE (c); |
| 1045 if (UTF_8_1_OCTET_P (c)) | |
| 1046 continue; | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1047 incomplete = 1; |
| 88365 | 1048 ONE_MORE_BYTE (c1); |
| 1049 if (! UTF_8_EXTRA_OCTET_P (c1)) | |
| 1050 break; | |
| 1051 if (UTF_8_2_OCTET_LEADING_P (c)) | |
| 1052 { | |
| 1053 found++; | |
| 1054 continue; | |
| 1055 } | |
| 1056 ONE_MORE_BYTE (c2); | |
| 1057 if (! UTF_8_EXTRA_OCTET_P (c2)) | |
| 1058 break; | |
| 1059 if (UTF_8_3_OCTET_LEADING_P (c)) | |
| 1060 { | |
| 1061 found++; | |
| 1062 continue; | |
| 1063 } | |
| 1064 ONE_MORE_BYTE (c3); | |
| 1065 if (! UTF_8_EXTRA_OCTET_P (c3)) | |
| 1066 break; | |
| 1067 if (UTF_8_4_OCTET_LEADING_P (c)) | |
| 1068 { | |
| 1069 found++; | |
| 1070 continue; | |
| 1071 } | |
| 1072 ONE_MORE_BYTE (c4); | |
| 1073 if (! UTF_8_EXTRA_OCTET_P (c4)) | |
| 1074 break; | |
| 1075 if (UTF_8_5_OCTET_LEADING_P (c)) | |
| 1076 { | |
| 1077 found++; | |
| 1078 continue; | |
| 1079 } | |
| 1080 break; | |
| 1081 } | |
| 1082 *mask &= ~CATEGORY_MASK_UTF_8; | |
| 1083 return 0; | |
| 1084 | |
| 1085 no_more_source: | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1086 if (incomplete && coding->mode & CODING_MODE_LAST_BLOCK) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1087 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1088 *mask &= ~CATEGORY_MASK_UTF_8; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1089 return 0; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1090 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1091 return found; |
| 88365 | 1092 } |
| 1093 | |
| 1094 | |
| 1095 static void | |
| 1096 decode_coding_utf_8 (coding) | |
| 1097 struct coding_system *coding; | |
| 1098 { | |
| 1099 unsigned char *src = coding->source + coding->consumed; | |
| 1100 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 1101 unsigned char *src_base; | |
| 1102 int *charbuf = coding->charbuf; | |
| 1103 int *charbuf_end = charbuf + coding->charbuf_size; | |
| 1104 int consumed_chars = 0, consumed_chars_base; | |
| 1105 int multibytep = coding->src_multibyte; | |
| 1106 Lisp_Object attr, eol_type, charset_list; | |
| 1107 | |
| 1108 CODING_GET_INFO (coding, attr, eol_type, charset_list); | |
| 1109 | |
| 1110 while (1) | |
| 1111 { | |
| 1112 int c, c1, c2, c3, c4, c5; | |
| 1113 | |
| 1114 src_base = src; | |
| 1115 consumed_chars_base = consumed_chars; | |
| 1116 | |
| 1117 if (charbuf >= charbuf_end) | |
| 1118 break; | |
| 1119 | |
| 1120 ONE_MORE_BYTE (c1); | |
| 1121 if (UTF_8_1_OCTET_P(c1)) | |
| 1122 { | |
| 1123 c = c1; | |
| 1124 if (c == '\r') | |
| 1125 { | |
| 1126 if (EQ (eol_type, Qdos)) | |
| 1127 { | |
| 1128 if (src == src_end) | |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
1129 { |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
1130 coding->result = CODING_RESULT_INSUFFICIENT_SRC; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
1131 goto no_more_source; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
1132 } |
| 88365 | 1133 if (*src == '\n') |
| 1134 ONE_MORE_BYTE (c); | |
| 1135 } | |
| 1136 else if (EQ (eol_type, Qmac)) | |
| 1137 c = '\n'; | |
| 1138 } | |
| 1139 } | |
| 1140 else | |
| 1141 { | |
| 1142 ONE_MORE_BYTE (c2); | |
| 1143 if (! UTF_8_EXTRA_OCTET_P (c2)) | |
| 1144 goto invalid_code; | |
| 1145 if (UTF_8_2_OCTET_LEADING_P (c1)) | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1146 { |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1147 c = ((c1 & 0x1F) << 6) | (c2 & 0x3F); |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1148 /* Reject overlong sequences here and below. Encoders |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1149 producing them are incorrect, they can be misleading, |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1150 and they mess up read/write invariance. */ |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1151 if (c < 128) |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1152 goto invalid_code; |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1153 } |
| 88365 | 1154 else |
| 1155 { | |
| 1156 ONE_MORE_BYTE (c3); | |
| 1157 if (! UTF_8_EXTRA_OCTET_P (c3)) | |
| 1158 goto invalid_code; | |
| 1159 if (UTF_8_3_OCTET_LEADING_P (c1)) | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1160 { |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1161 c = (((c1 & 0xF) << 12) |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1162 | ((c2 & 0x3F) << 6) | (c3 & 0x3F)); |
|
89184
88a9e962e183
(decode_coding_utf_8): Treat surrogates as invalid.
Dave Love <fx@gnu.org>
parents:
89042
diff
changeset
|
1163 if (c < 0x800 |
|
88a9e962e183
(decode_coding_utf_8): Treat surrogates as invalid.
Dave Love <fx@gnu.org>
parents:
89042
diff
changeset
|
1164 || (c >= 0xd800 && c < 0xe000)) /* surrogates (invalid) */ |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1165 goto invalid_code; |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1166 } |
| 88365 | 1167 else |
| 1168 { | |
| 1169 ONE_MORE_BYTE (c4); | |
| 1170 if (! UTF_8_EXTRA_OCTET_P (c4)) | |
| 1171 goto invalid_code; | |
| 1172 if (UTF_8_4_OCTET_LEADING_P (c1)) | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1173 { |
| 88365 | 1174 c = (((c1 & 0x7) << 18) | ((c2 & 0x3F) << 12) |
| 1175 | ((c3 & 0x3F) << 6) | (c4 & 0x3F)); | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1176 if (c < 0x10000) |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1177 goto invalid_code; |
|
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1178 } |
| 88365 | 1179 else |
| 1180 { | |
| 1181 ONE_MORE_BYTE (c5); | |
| 1182 if (! UTF_8_EXTRA_OCTET_P (c5)) | |
| 1183 goto invalid_code; | |
| 1184 if (UTF_8_5_OCTET_LEADING_P (c1)) | |
| 1185 { | |
| 1186 c = (((c1 & 0x3) << 24) | ((c2 & 0x3F) << 18) | |
| 1187 | ((c3 & 0x3F) << 12) | ((c4 & 0x3F) << 6) | |
| 1188 | (c5 & 0x3F)); | |
|
88669
0bc5868f9f61
(decode_coding_utf_8): Reject overlong sequences.
Dave Love <fx@gnu.org>
parents:
88646
diff
changeset
|
1189 if ((c > MAX_CHAR) || (c < 0x200000)) |
| 88365 | 1190 goto invalid_code; |
| 1191 } | |
| 1192 else | |
| 1193 goto invalid_code; | |
| 1194 } | |
| 1195 } | |
| 1196 } | |
| 1197 } | |
| 1198 | |
| 1199 *charbuf++ = c; | |
| 1200 continue; | |
| 1201 | |
| 1202 invalid_code: | |
| 1203 src = src_base; | |
| 1204 consumed_chars = consumed_chars_base; | |
| 1205 ONE_MORE_BYTE (c); | |
| 1206 *charbuf++ = ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); | |
| 1207 coding->errors++; | |
| 1208 } | |
| 1209 | |
| 1210 no_more_source: | |
| 1211 coding->consumed_char += consumed_chars_base; | |
| 1212 coding->consumed = src_base - coding->source; | |
| 1213 coding->charbuf_used = charbuf - coding->charbuf; | |
| 1214 } | |
| 1215 | |
| 1216 | |
| 1217 static int | |
| 1218 encode_coding_utf_8 (coding) | |
| 1219 struct coding_system *coding; | |
| 1220 { | |
| 1221 int multibytep = coding->dst_multibyte; | |
| 1222 int *charbuf = coding->charbuf; | |
| 1223 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 1224 unsigned char *dst = coding->destination + coding->produced; | |
| 1225 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1226 int produced_chars = 0; |
| 88365 | 1227 int c; |
| 1228 | |
| 1229 if (multibytep) | |
| 1230 { | |
| 1231 int safe_room = MAX_MULTIBYTE_LENGTH * 2; | |
| 1232 | |
| 1233 while (charbuf < charbuf_end) | |
| 1234 { | |
| 1235 unsigned char str[MAX_MULTIBYTE_LENGTH], *p, *pend = str; | |
| 1236 | |
| 1237 ASSURE_DESTINATION (safe_room); | |
| 1238 c = *charbuf++; | |
|
89042
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1239 if (CHAR_BYTE8_P (c)) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1240 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1241 c = CHAR_TO_BYTE8 (c); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1242 EMIT_ONE_BYTE (c); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1243 } |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1244 else |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1245 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1246 CHAR_STRING_ADVANCE (c, pend); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1247 for (p = str; p < pend; p++) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1248 EMIT_ONE_BYTE (*p); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
1249 } |
| 88365 | 1250 } |
| 1251 } | |
| 1252 else | |
| 1253 { | |
| 1254 int safe_room = MAX_MULTIBYTE_LENGTH; | |
| 1255 | |
| 1256 while (charbuf < charbuf_end) | |
| 1257 { | |
| 1258 ASSURE_DESTINATION (safe_room); | |
| 1259 c = *charbuf++; | |
| 1260 dst += CHAR_STRING (c, dst); | |
| 1261 produced_chars++; | |
| 1262 } | |
| 1263 } | |
| 1264 coding->result = CODING_RESULT_SUCCESS; | |
| 1265 coding->produced_char += produced_chars; | |
| 1266 coding->produced = dst - coding->destination; | |
| 1267 return 0; | |
| 1268 } | |
| 1269 | |
| 1270 | |
| 1271 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
| 1272 Check if a text is encoded in UTF-16 Big Endian (endian == 1) or | |
| 1273 Little Endian (otherwise). If it is, return | |
| 1274 CATEGORY_MASK_UTF_16_BE or CATEGORY_MASK_UTF_16_LE, | |
| 1275 else return 0. */ | |
| 1276 | |
| 1277 #define UTF_16_HIGH_SURROGATE_P(val) \ | |
| 1278 (((val) & 0xFC00) == 0xD800) | |
| 1279 | |
| 1280 #define UTF_16_LOW_SURROGATE_P(val) \ | |
| 1281 (((val) & 0xFC00) == 0xDC00) | |
| 1282 | |
| 1283 #define UTF_16_INVALID_P(val) \ | |
| 1284 (((val) == 0xFFFE) \ | |
| 1285 || ((val) == 0xFFFF) \ | |
| 1286 || UTF_16_LOW_SURROGATE_P (val)) | |
| 1287 | |
| 1288 | |
| 1289 static int | |
| 1290 detect_coding_utf_16 (coding, mask) | |
| 1291 struct coding_system *coding; | |
| 1292 int *mask; | |
| 1293 { | |
| 1294 unsigned char *src = coding->source, *src_base = src; | |
| 1295 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 1296 int multibytep = coding->src_multibyte; | |
| 1297 int consumed_chars = 0; | |
| 1298 int c1, c2; | |
| 1299 | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1300 *mask &= ~CATEGORY_MASK_UTF_16; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1301 |
| 88365 | 1302 ONE_MORE_BYTE (c1); |
| 1303 ONE_MORE_BYTE (c2); | |
| 1304 | |
| 1305 if ((c1 == 0xFF) && (c2 == 0xFE)) | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1306 *mask |= CATEGORY_MASK_UTF_16_LE; |
| 88365 | 1307 else if ((c1 == 0xFE) && (c2 == 0xFF)) |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1308 *mask |= CATEGORY_MASK_UTF_16_BE; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1309 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1310 *mask |= CATEGORY_MASK_UTF_16_BE_NOSIG | CATEGORY_MASK_UTF_16_LE_NOSIG; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1311 return 1; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1312 |
| 88365 | 1313 no_more_source: |
| 1314 return 0; | |
| 1315 } | |
| 1316 | |
| 1317 static void | |
| 1318 decode_coding_utf_16 (coding) | |
| 1319 struct coding_system *coding; | |
| 1320 { | |
| 1321 unsigned char *src = coding->source + coding->consumed; | |
| 1322 unsigned char *src_end = coding->source + coding->src_bytes; | |
|
88430
6418a272b97e
* coding.c: Delete unused variables.
Kenichi Handa <handa@m17n.org>
parents:
88365
diff
changeset
|
1323 unsigned char *src_base; |
| 88365 | 1324 int *charbuf = coding->charbuf; |
| 1325 int *charbuf_end = charbuf + coding->charbuf_size; | |
| 1326 int consumed_chars = 0, consumed_chars_base; | |
| 1327 int multibytep = coding->src_multibyte; | |
| 1328 enum utf_16_bom_type bom = CODING_UTF_16_BOM (coding); | |
| 1329 enum utf_16_endian_type endian = CODING_UTF_16_ENDIAN (coding); | |
| 1330 int surrogate = CODING_UTF_16_SURROGATE (coding); | |
| 1331 Lisp_Object attr, eol_type, charset_list; | |
| 1332 | |
| 1333 CODING_GET_INFO (coding, attr, eol_type, charset_list); | |
| 1334 | |
| 1335 if (bom != utf_16_without_bom) | |
| 1336 { | |
| 1337 int c, c1, c2; | |
| 1338 | |
| 1339 src_base = src; | |
| 1340 ONE_MORE_BYTE (c1); | |
| 1341 ONE_MORE_BYTE (c2); | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1342 c = (c1 << 8) | c2; |
| 88365 | 1343 if (bom == utf_16_with_bom) |
| 1344 { | |
| 1345 if (endian == utf_16_big_endian | |
| 1346 ? c != 0xFFFE : c != 0xFEFF) | |
| 1347 { | |
| 1348 /* We are sure that there's enouph room at CHARBUF. */ | |
| 1349 *charbuf++ = c1; | |
| 1350 *charbuf++ = c2; | |
| 1351 coding->errors++; | |
| 1352 } | |
| 1353 } | |
| 1354 else | |
| 1355 { | |
| 1356 if (c == 0xFFFE) | |
| 1357 CODING_UTF_16_ENDIAN (coding) | |
| 1358 = endian = utf_16_big_endian; | |
| 1359 else if (c == 0xFEFF) | |
| 1360 CODING_UTF_16_ENDIAN (coding) | |
| 1361 = endian = utf_16_little_endian; | |
| 1362 else | |
| 1363 { | |
| 1364 CODING_UTF_16_ENDIAN (coding) | |
| 1365 = endian = utf_16_big_endian; | |
| 1366 src = src_base; | |
| 1367 } | |
| 1368 } | |
| 1369 CODING_UTF_16_BOM (coding) = utf_16_with_bom; | |
| 1370 } | |
| 1371 | |
| 1372 while (1) | |
| 1373 { | |
| 1374 int c, c1, c2; | |
| 1375 | |
| 1376 src_base = src; | |
| 1377 consumed_chars_base = consumed_chars; | |
| 1378 | |
| 1379 if (charbuf + 2 >= charbuf_end) | |
| 1380 break; | |
| 1381 | |
| 1382 ONE_MORE_BYTE (c1); | |
| 1383 ONE_MORE_BYTE (c2); | |
| 1384 c = (endian == utf_16_big_endian | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1385 ? ((c1 << 8) | c2) : ((c2 << 8) | c1)); |
| 88365 | 1386 if (surrogate) |
| 1387 { | |
| 1388 if (! UTF_16_LOW_SURROGATE_P (c)) | |
| 1389 { | |
| 1390 if (endian == utf_16_big_endian) | |
| 1391 c1 = surrogate >> 8, c2 = surrogate & 0xFF; | |
| 1392 else | |
| 1393 c1 = surrogate & 0xFF, c2 = surrogate >> 8; | |
| 1394 *charbuf++ = c1; | |
| 1395 *charbuf++ = c2; | |
| 1396 coding->errors++; | |
| 1397 if (UTF_16_HIGH_SURROGATE_P (c)) | |
| 1398 CODING_UTF_16_SURROGATE (coding) = surrogate = c; | |
| 1399 else | |
| 1400 *charbuf++ = c; | |
| 1401 } | |
| 1402 else | |
| 1403 { | |
| 1404 c = ((surrogate - 0xD800) << 10) | (c - 0xDC00); | |
| 1405 CODING_UTF_16_SURROGATE (coding) = surrogate = 0; | |
| 1406 *charbuf++ = c; | |
| 1407 } | |
| 1408 } | |
| 1409 else | |
| 1410 { | |
| 1411 if (UTF_16_HIGH_SURROGATE_P (c)) | |
| 1412 CODING_UTF_16_SURROGATE (coding) = surrogate = c; | |
| 1413 else | |
| 1414 *charbuf++ = c; | |
| 1415 } | |
| 1416 } | |
| 1417 | |
| 1418 no_more_source: | |
| 1419 coding->consumed_char += consumed_chars_base; | |
| 1420 coding->consumed = src_base - coding->source; | |
| 1421 coding->charbuf_used = charbuf - coding->charbuf; | |
| 1422 } | |
| 1423 | |
| 1424 static int | |
| 1425 encode_coding_utf_16 (coding) | |
| 1426 struct coding_system *coding; | |
| 1427 { | |
| 1428 int multibytep = coding->dst_multibyte; | |
| 1429 int *charbuf = coding->charbuf; | |
| 1430 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 1431 unsigned char *dst = coding->destination + coding->produced; | |
| 1432 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 1433 int safe_room = 8; | |
| 1434 enum utf_16_bom_type bom = CODING_UTF_16_BOM (coding); | |
| 1435 int big_endian = CODING_UTF_16_ENDIAN (coding) == utf_16_big_endian; | |
| 1436 int produced_chars = 0; | |
| 1437 Lisp_Object attrs, eol_type, charset_list; | |
| 1438 int c; | |
| 1439 | |
| 1440 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
| 1441 | |
| 1442 if (bom == utf_16_with_bom) | |
| 1443 { | |
| 1444 ASSURE_DESTINATION (safe_room); | |
| 1445 if (big_endian) | |
| 1446 EMIT_TWO_BYTES (0xFF, 0xFE); | |
| 1447 else | |
| 1448 EMIT_TWO_BYTES (0xFE, 0xFF); | |
| 1449 CODING_UTF_16_BOM (coding) = utf_16_without_bom; | |
| 1450 } | |
| 1451 | |
| 1452 while (charbuf < charbuf_end) | |
| 1453 { | |
| 1454 ASSURE_DESTINATION (safe_room); | |
| 1455 c = *charbuf++; | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1456 if (c >= MAX_UNICODE_CHAR) |
|
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
1457 c = coding->default_char; |
| 88365 | 1458 |
| 1459 if (c < 0x10000) | |
| 1460 { | |
| 1461 if (big_endian) | |
| 1462 EMIT_TWO_BYTES (c >> 8, c & 0xFF); | |
| 1463 else | |
| 1464 EMIT_TWO_BYTES (c & 0xFF, c >> 8); | |
| 1465 } | |
| 1466 else | |
| 1467 { | |
| 1468 int c1, c2; | |
| 1469 | |
| 1470 c -= 0x10000; | |
| 1471 c1 = (c >> 10) + 0xD800; | |
| 1472 c2 = (c & 0x3FF) + 0xDC00; | |
| 1473 if (big_endian) | |
| 1474 EMIT_FOUR_BYTES (c1 >> 8, c1 & 0xFF, c2 >> 8, c2 & 0xFF); | |
| 1475 else | |
| 1476 EMIT_FOUR_BYTES (c1 & 0xFF, c1 >> 8, c2 & 0xFF, c2 >> 8); | |
| 1477 } | |
| 1478 } | |
| 1479 coding->result = CODING_RESULT_SUCCESS; | |
| 1480 coding->produced = dst - coding->destination; | |
| 1481 coding->produced_char += produced_chars; | |
| 1482 return 0; | |
| 1483 } | |
| 1484 | |
| 1485 | |
| 1486 /*** 6. Old Emacs' internal format (emacs-mule) ***/ | |
| 17052 | 1487 |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1488 /* Emacs' internal format for representation of multiple character |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1489 sets is a kind of multi-byte encoding, i.e. characters are |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1490 represented by variable-length sequences of one-byte codes. |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1491 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1492 ASCII characters and control characters (e.g. `tab', `newline') are |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1493 represented by one-byte sequences which are their ASCII codes, in |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1494 the range 0x00 through 0x7F. |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1495 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1496 8-bit characters of the range 0x80..0x9F are represented by |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1497 two-byte sequences of LEADING_CODE_8_BIT_CONTROL and (their 8-bit |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1498 code + 0x20). |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1499 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1500 8-bit characters of the range 0xA0..0xFF are represented by |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1501 one-byte sequences which are their 8-bit code. |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1502 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1503 The other characters are represented by a sequence of `base |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1504 leading-code', optional `extended leading-code', and one or two |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1505 `position-code's. The length of the sequence is determined by the |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1506 base leading-code. Leading-code takes the range 0x81 through 0x9D, |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1507 whereas extended leading-code and position-code take the range 0xA0 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1508 through 0xFF. See `charset.h' for more details about leading-code |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1509 and position-code. |
| 18766 | 1510 |
| 17052 | 1511 --- CODE RANGE of Emacs' internal format --- |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1512 character set range |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1513 ------------- ----- |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1514 ascii 0x00..0x7F |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1515 eight-bit-control LEADING_CODE_8_BIT_CONTROL + 0xA0..0xBF |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1516 eight-bit-graphic 0xA0..0xBF |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1517 ELSE 0x81..0x9D + [0xA0..0xFF]+ |
| 17052 | 1518 --------------------------------------------- |
| 1519 | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1520 As this is the internal character representation, the format is |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1521 usually not used externally (i.e. in a file or in a data sent to a |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1522 process). But, it is possible to have a text externally in this |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1523 format (i.e. by encoding by the coding system `emacs-mule'). |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1524 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1525 In that case, a sequence of one-byte codes has a slightly different |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1526 form. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1527 |
| 88365 | 1528 At first, all characters in eight-bit-control are represented by |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1529 one-byte sequences which are their 8-bit code. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1530 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1531 Next, character composition data are represented by the byte |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1532 sequence of the form: 0x80 METHOD BYTES CHARS COMPONENT ..., |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1533 where, |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1534 METHOD is 0xF0 plus one of composition method (enum |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1535 composition_method), |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1536 |
| 88365 | 1537 BYTES is 0xA0 plus a byte length of this composition data, |
| 1538 | |
| 1539 CHARS is 0x20 plus a number of characters composed by this | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1540 data, |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1541 |
| 88365 | 1542 COMPONENTs are characters of multibye form or composition |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1543 rules encoded by two-byte of ASCII codes. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1544 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1545 In addition, for backward compatibility, the following formats are |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1546 also recognized as composition data on decoding. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1547 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1548 0x80 MSEQ ... |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1549 0x80 0xFF MSEQ RULE MSEQ RULE ... MSEQ |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1550 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1551 Here, |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1552 MSEQ is a multibyte form but in these special format: |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1553 ASCII: 0xA0 ASCII_CODE+0x80, |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1554 other: LEADING_CODE+0x20 FOLLOWING-BYTE ..., |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1555 RULE is a one byte code of the range 0xA0..0xF0 that |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1556 represents a composition rule. |
| 17052 | 1557 */ |
| 1558 | |
| 88365 | 1559 char emacs_mule_bytes[256]; |
| 1560 | |
| 1561 int | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1562 emacs_mule_char (coding, src, nbytes, nchars) |
| 88365 | 1563 struct coding_system *coding; |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1564 unsigned char *src; |
| 88365 | 1565 int *nbytes, *nchars; |
| 1566 { | |
| 1567 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 1568 int multibytep = coding->src_multibyte; | |
| 1569 unsigned char *src_base = src; | |
| 1570 struct charset *charset; | |
| 1571 unsigned code; | |
| 1572 int c; | |
| 1573 int consumed_chars = 0; | |
| 1574 | |
| 1575 ONE_MORE_BYTE (c); | |
| 1576 switch (emacs_mule_bytes[c]) | |
| 1577 { | |
| 1578 case 2: | |
| 1579 if (! (charset = emacs_mule_charset[c])) | |
| 1580 goto invalid_code; | |
| 1581 ONE_MORE_BYTE (c); | |
| 1582 code = c & 0x7F; | |
| 1583 break; | |
| 1584 | |
| 1585 case 3: | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
1586 if (c == EMACS_MULE_LEADING_CODE_PRIVATE_11 |
|
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
1587 || c == EMACS_MULE_LEADING_CODE_PRIVATE_12) |
| 88365 | 1588 { |
| 1589 ONE_MORE_BYTE (c); | |
| 1590 if (! (charset = emacs_mule_charset[c])) | |
| 1591 goto invalid_code; | |
| 1592 ONE_MORE_BYTE (c); | |
| 1593 code = c & 0x7F; | |
| 1594 } | |
| 1595 else | |
| 1596 { | |
| 1597 if (! (charset = emacs_mule_charset[c])) | |
| 1598 goto invalid_code; | |
| 1599 ONE_MORE_BYTE (c); | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1600 code = (c & 0x7F) << 8; |
| 88365 | 1601 ONE_MORE_BYTE (c); |
| 1602 code |= c & 0x7F; | |
| 1603 } | |
| 1604 break; | |
| 1605 | |
| 1606 case 4: | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1607 ONE_MORE_BYTE (c); |
| 88365 | 1608 if (! (charset = emacs_mule_charset[c])) |
| 1609 goto invalid_code; | |
| 1610 ONE_MORE_BYTE (c); | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1611 code = (c & 0x7F) << 8; |
| 88365 | 1612 ONE_MORE_BYTE (c); |
| 1613 code |= c & 0x7F; | |
| 1614 break; | |
| 1615 | |
| 1616 case 1: | |
| 1617 code = c; | |
|
88950
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
1618 charset = CHARSET_FROM_ID (ASCII_BYTE_P (code) |
|
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
1619 ? charset_ascii : charset_eight_bit); |
| 88365 | 1620 break; |
| 1621 | |
| 1622 default: | |
| 1623 abort (); | |
| 1624 } | |
| 1625 c = DECODE_CHAR (charset, code); | |
| 1626 if (c < 0) | |
| 1627 goto invalid_code; | |
| 1628 *nbytes = src - src_base; | |
| 1629 *nchars = consumed_chars; | |
| 1630 return c; | |
| 1631 | |
| 1632 no_more_source: | |
| 1633 return -2; | |
| 1634 | |
| 1635 invalid_code: | |
| 1636 return -1; | |
| 1637 } | |
| 1638 | |
| 17052 | 1639 |
| 1640 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
| 88365 | 1641 Check if a text is encoded in `emacs-mule'. */ |
| 17052 | 1642 |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
1643 static int |
| 88365 | 1644 detect_coding_emacs_mule (coding, mask) |
| 1645 struct coding_system *coding; | |
| 1646 int *mask; | |
| 17052 | 1647 { |
| 88365 | 1648 unsigned char *src = coding->source, *src_base = src; |
| 1649 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 1650 int multibytep = coding->src_multibyte; | |
| 1651 int consumed_chars = 0; | |
| 1652 int c; | |
| 1653 int found = 0; | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1654 int incomplete; |
| 88365 | 1655 |
| 1656 /* A coding system of this category is always ASCII compatible. */ | |
| 1657 src += coding->head_ascii; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1658 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1659 while (1) |
| 17052 | 1660 { |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1661 incomplete = 0; |
| 88365 | 1662 ONE_MORE_BYTE (c); |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1663 incomplete = 1; |
| 88365 | 1664 |
| 1665 if (c == 0x80) | |
| 17052 | 1666 { |
| 88365 | 1667 /* Perhaps the start of composite character. We simple skip |
| 1668 it because analyzing it is too heavy for detecting. But, | |
| 1669 at least, we check that the composite character | |
| 1670 constitues of more than 4 bytes. */ | |
| 1671 unsigned char *src_base; | |
| 1672 | |
| 1673 repeat: | |
| 1674 src_base = src; | |
| 1675 do | |
| 1676 { | |
| 1677 ONE_MORE_BYTE (c); | |
| 1678 } | |
| 1679 while (c >= 0xA0); | |
| 1680 | |
| 1681 if (src - src_base <= 4) | |
| 1682 break; | |
| 1683 found = 1; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1684 if (c == 0x80) |
| 88365 | 1685 goto repeat; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1686 } |
| 88365 | 1687 |
| 1688 if (c < 0x80) | |
| 1689 { | |
| 1690 if (c < 0x20 | |
| 1691 && (c == ISO_CODE_ESC || c == ISO_CODE_SI || c == ISO_CODE_SO)) | |
| 1692 break; | |
| 1693 } | |
| 1694 else | |
| 1695 { | |
| 1696 unsigned char *src_base = src - 1; | |
| 1697 | |
| 1698 do | |
| 1699 { | |
| 1700 ONE_MORE_BYTE (c); | |
| 1701 } | |
| 1702 while (c >= 0xA0); | |
| 1703 if (src - src_base != emacs_mule_bytes[*src_base]) | |
| 1704 break; | |
| 1705 found = 1; | |
| 1706 } | |
| 1707 } | |
| 1708 *mask &= ~CATEGORY_MASK_EMACS_MULE; | |
| 1709 return 0; | |
| 1710 | |
| 1711 no_more_source: | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1712 if (incomplete && coding->mode & CODING_MODE_LAST_BLOCK) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1713 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1714 *mask &= ~CATEGORY_MASK_EMACS_MULE; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1715 return 0; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1716 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
1717 return found; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1718 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1719 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1720 |
| 88365 | 1721 /* See the above "GENERAL NOTES on `decode_coding_XXX ()' functions". */ |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1722 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1723 /* Decode a character represented as a component of composition |
| 88365 | 1724 sequence of Emacs 20/21 style at SRC. Set C to that character and |
| 1725 update SRC to the head of next character (or an encoded composition | |
| 1726 rule). If SRC doesn't points a composition component, set C to -1. | |
| 1727 If SRC points an invalid byte sequence, global exit by a return | |
| 1728 value 0. */ | |
| 1729 | |
| 1730 #define DECODE_EMACS_MULE_COMPOSITION_CHAR(buf) \ | |
| 1731 if (1) \ | |
| 1732 { \ | |
| 1733 int c; \ | |
| 1734 int nbytes, nchars; \ | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1735 \ |
| 88365 | 1736 if (src == src_end) \ |
| 1737 break; \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1738 c = emacs_mule_char (coding, src, &nbytes, &nchars); \ |
| 88365 | 1739 if (c < 0) \ |
| 1740 { \ | |
| 1741 if (c == -2) \ | |
| 1742 break; \ | |
| 1743 goto invalid_code; \ | |
| 1744 } \ | |
| 1745 *buf++ = c; \ | |
| 1746 src += nbytes; \ | |
| 1747 consumed_chars += nchars; \ | |
| 1748 } \ | |
| 1749 else | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1750 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1751 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1752 /* Decode a composition rule represented as a component of composition |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1753 sequence of Emacs 20 style at SRC. Store the decoded rule in *BUF, |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1754 and increment BUF. If SRC points an invalid byte sequence, set C |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1755 to -1. */ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1756 |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1757 #define DECODE_EMACS_MULE_COMPOSITION_RULE_20(buf) \ |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1758 do { \ |
| 88365 | 1759 int c, gref, nref; \ |
| 1760 \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1761 if (src >= src_end) \ |
| 88365 | 1762 goto invalid_code; \ |
| 1763 ONE_MORE_BYTE_NO_CHECK (c); \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1764 c -= 0x20; \ |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1765 if (c < 0 || c >= 81) \ |
| 88365 | 1766 goto invalid_code; \ |
| 1767 \ | |
| 1768 gref = c / 9, nref = c % 9; \ | |
| 1769 *buf++ = COMPOSITION_ENCODE_RULE (gref, nref); \ | |
| 1770 } while (0) | |
| 1771 | |
| 1772 | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1773 /* Decode a composition rule represented as a component of composition |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1774 sequence of Emacs 21 style at SRC. Store the decoded rule in *BUF, |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1775 and increment BUF. If SRC points an invalid byte sequence, set C |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1776 to -1. */ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1777 |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1778 #define DECODE_EMACS_MULE_COMPOSITION_RULE_21(buf) \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1779 do { \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1780 int gref, nref; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1781 \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1782 if (src + 1>= src_end) \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1783 goto invalid_code; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1784 ONE_MORE_BYTE_NO_CHECK (gref); \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1785 gref -= 0x20; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1786 ONE_MORE_BYTE_NO_CHECK (nref); \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1787 nref -= 0x20; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1788 if (gref < 0 || gref >= 81 \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1789 || nref < 0 || nref >= 81) \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1790 goto invalid_code; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1791 *buf++ = COMPOSITION_ENCODE_RULE (gref, nref); \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1792 } while (0) |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1793 |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1794 |
| 88365 | 1795 #define ADD_COMPOSITION_DATA(buf, method, nchars) \ |
| 1796 do { \ | |
| 1797 *buf++ = -5; \ | |
| 1798 *buf++ = coding->produced_char + char_offset; \ | |
| 1799 *buf++ = CODING_ANNOTATE_COMPOSITION_MASK; \ | |
| 1800 *buf++ = method; \ | |
| 1801 *buf++ = nchars; \ | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1802 } while (0) |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1803 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1804 |
| 88365 | 1805 #define DECODE_EMACS_MULE_21_COMPOSITION(c) \ |
| 1806 do { \ | |
| 1807 /* Emacs 21 style format. The first three bytes at SRC are \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1808 (METHOD - 0xF2), (BYTES - 0xA0), (CHARS - 0xA0), where BYTES is \ |
| 88365 | 1809 the byte length of this composition information, CHARS is the \ |
| 1810 number of characters composed by this composition. */ \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1811 enum composition_method method = c - 0xF2; \ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1812 int *charbuf_base = charbuf; \ |
| 88365 | 1813 int consumed_chars_limit; \ |
| 1814 int nbytes, nchars; \ | |
| 1815 \ | |
| 1816 ONE_MORE_BYTE (c); \ | |
| 1817 nbytes = c - 0xA0; \ | |
| 1818 if (nbytes < 3) \ | |
| 1819 goto invalid_code; \ | |
| 1820 ONE_MORE_BYTE (c); \ | |
| 1821 nchars = c - 0xA0; \ | |
| 1822 ADD_COMPOSITION_DATA (charbuf, method, nchars); \ | |
| 1823 consumed_chars_limit = consumed_chars_base + nbytes; \ | |
| 1824 if (method != COMPOSITION_RELATIVE) \ | |
| 1825 { \ | |
| 1826 int i = 0; \ | |
| 1827 while (consumed_chars < consumed_chars_limit) \ | |
| 1828 { \ | |
| 1829 if (i % 2 && method != COMPOSITION_WITH_ALTCHARS) \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1830 DECODE_EMACS_MULE_COMPOSITION_RULE_21 (charbuf); \ |
| 88365 | 1831 else \ |
| 1832 DECODE_EMACS_MULE_COMPOSITION_CHAR (charbuf); \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1833 i++; \ |
| 88365 | 1834 } \ |
| 1835 if (consumed_chars < consumed_chars_limit) \ | |
| 1836 goto invalid_code; \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1837 charbuf_base[0] -= i; \ |
| 88365 | 1838 } \ |
| 1839 } while (0) | |
| 1840 | |
| 1841 | |
| 1842 #define DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION(c) \ | |
| 1843 do { \ | |
| 1844 /* Emacs 20 style format for relative composition. */ \ | |
| 1845 /* Store multibyte form of characters to be composed. */ \ | |
| 1846 int components[MAX_COMPOSITION_COMPONENTS * 2 - 1]; \ | |
| 1847 int *buf = components; \ | |
| 1848 int i, j; \ | |
| 1849 \ | |
| 1850 src = src_base; \ | |
| 1851 ONE_MORE_BYTE (c); /* skip 0x80 */ \ | |
| 1852 for (i = 0; i < MAX_COMPOSITION_COMPONENTS; i++) \ | |
| 1853 DECODE_EMACS_MULE_COMPOSITION_CHAR (buf); \ | |
| 1854 if (i < 2) \ | |
| 1855 goto invalid_code; \ | |
| 1856 ADD_COMPOSITION_DATA (charbuf, COMPOSITION_RELATIVE, i); \ | |
| 1857 for (j = 0; j < i; j++) \ | |
| 1858 *charbuf++ = components[j]; \ | |
| 1859 } while (0) | |
| 1860 | |
| 1861 | |
| 1862 #define DECODE_EMACS_MULE_20_RULEBASE_COMPOSITION(c) \ | |
| 1863 do { \ | |
| 1864 /* Emacs 20 style format for rule-base composition. */ \ | |
| 1865 /* Store multibyte form of characters to be composed. */ \ | |
| 1866 int components[MAX_COMPOSITION_COMPONENTS * 2 - 1]; \ | |
| 1867 int *buf = components; \ | |
| 1868 int i, j; \ | |
| 1869 \ | |
| 1870 DECODE_EMACS_MULE_COMPOSITION_CHAR (buf); \ | |
| 1871 for (i = 0; i < MAX_COMPOSITION_COMPONENTS; i++) \ | |
| 1872 { \ | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1873 DECODE_EMACS_MULE_COMPOSITION_RULE_20 (buf); \ |
| 88365 | 1874 DECODE_EMACS_MULE_COMPOSITION_CHAR (buf); \ |
| 1875 } \ | |
| 1876 if (i < 1 || (buf - components) % 2 == 0) \ | |
| 1877 goto invalid_code; \ | |
| 1878 if (charbuf + i + (i / 2) + 1 < charbuf_end) \ | |
| 1879 goto no_more_source; \ | |
| 1880 ADD_COMPOSITION_DATA (buf, COMPOSITION_WITH_RULE, i); \ | |
| 1881 for (j = 0; j < i; j++) \ | |
| 1882 *charbuf++ = components[j]; \ | |
| 1883 for (j = 0; j < i; j += 2) \ | |
| 1884 *charbuf++ = components[j]; \ | |
| 1885 } while (0) | |
| 1886 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1887 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1888 static void |
| 88365 | 1889 decode_coding_emacs_mule (coding) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1890 struct coding_system *coding; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1891 { |
| 88365 | 1892 unsigned char *src = coding->source + coding->consumed; |
| 1893 unsigned char *src_end = coding->source + coding->src_bytes; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
1894 unsigned char *src_base; |
| 88365 | 1895 int *charbuf = coding->charbuf; |
| 1896 int *charbuf_end = charbuf + coding->charbuf_size; | |
| 1897 int consumed_chars = 0, consumed_chars_base; | |
| 1898 int char_offset = 0; | |
| 1899 int multibytep = coding->src_multibyte; | |
| 1900 Lisp_Object attrs, eol_type, charset_list; | |
| 1901 | |
| 1902 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
| 1903 | |
| 1904 while (1) | |
| 1905 { | |
| 1906 int c; | |
| 1907 | |
| 1908 src_base = src; | |
| 1909 consumed_chars_base = consumed_chars; | |
| 1910 | |
| 1911 if (charbuf >= charbuf_end) | |
| 1912 break; | |
| 1913 | |
| 1914 ONE_MORE_BYTE (c); | |
| 1915 | |
| 1916 if (c < 0x80) | |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
1917 { |
| 88365 | 1918 if (c == '\r') |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
1919 { |
| 88365 | 1920 if (EQ (eol_type, Qdos)) |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
1921 { |
| 88365 | 1922 if (src == src_end) |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
1923 { |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
1924 coding->result = CODING_RESULT_INSUFFICIENT_SRC; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
1925 goto no_more_source; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
1926 } |
| 88365 | 1927 if (*src == '\n') |
| 1928 ONE_MORE_BYTE (c); | |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
1929 } |
| 88365 | 1930 else if (EQ (eol_type, Qmac)) |
| 1931 c = '\n'; | |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
1932 } |
| 88365 | 1933 *charbuf++ = c; |
| 1934 char_offset++; | |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
1935 } |
| 88365 | 1936 else if (c == 0x80) |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
1937 { |
| 88365 | 1938 if (charbuf + 5 + (MAX_COMPOSITION_COMPONENTS * 2) - 1 > charbuf_end) |
| 1939 break; | |
| 1940 ONE_MORE_BYTE (c); | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1941 if (c - 0xF2 >= COMPOSITION_RELATIVE |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1942 && c - 0xF2 <= COMPOSITION_WITH_RULE_ALTCHARS) |
| 88365 | 1943 DECODE_EMACS_MULE_21_COMPOSITION (c); |
| 1944 else if (c < 0xC0) | |
| 1945 DECODE_EMACS_MULE_20_RELATIVE_COMPOSITION (c); | |
| 1946 else if (c == 0xFF) | |
| 1947 DECODE_EMACS_MULE_20_RULEBASE_COMPOSITION (c); | |
| 1948 else | |
| 1949 goto invalid_code; | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1950 coding->annotated = 1; |
|
32806
9502d0a5b2ad
(decode_coding_emacs_mule): If coding->eol_type is CR
Eli Zaretskii <eliz@gnu.org>
parents:
32745
diff
changeset
|
1951 } |
| 88365 | 1952 else if (c < 0xA0 && emacs_mule_bytes[c] > 1) |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1953 { |
| 88365 | 1954 int nbytes, nchars; |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1955 src = src_base; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1956 consumed_chars = consumed_chars_base; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1957 c = emacs_mule_char (coding, src, &nbytes, &nchars); |
| 88365 | 1958 if (c < 0) |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1959 { |
| 88365 | 1960 if (c == -2) |
| 1961 break; | |
| 1962 goto invalid_code; | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1963 } |
| 88365 | 1964 *charbuf++ = c; |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1965 src += nbytes; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
1966 consumed_chars += nchars; |
| 88365 | 1967 char_offset++; |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
1968 } |
| 88365 | 1969 continue; |
| 1970 | |
| 1971 invalid_code: | |
| 1972 src = src_base; | |
| 1973 consumed_chars = consumed_chars_base; | |
| 1974 ONE_MORE_BYTE (c); | |
| 1975 *charbuf++ = ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); | |
| 1976 coding->errors++; | |
| 1977 } | |
| 1978 | |
| 1979 no_more_source: | |
| 1980 coding->consumed_char += consumed_chars_base; | |
| 1981 coding->consumed = src_base - coding->source; | |
| 1982 coding->charbuf_used = charbuf - coding->charbuf; | |
| 1983 } | |
| 1984 | |
| 1985 | |
| 1986 #define EMACS_MULE_LEADING_CODES(id, codes) \ | |
| 1987 do { \ | |
| 1988 if (id < 0xA0) \ | |
| 1989 codes[0] = id, codes[1] = 0; \ | |
| 1990 else if (id < 0xE0) \ | |
| 1991 codes[0] = 0x9A, codes[1] = id; \ | |
| 1992 else if (id < 0xF0) \ | |
| 1993 codes[0] = 0x9B, codes[1] = id; \ | |
| 1994 else if (id < 0xF5) \ | |
| 1995 codes[0] = 0x9C, codes[1] = id; \ | |
| 1996 else \ | |
| 1997 codes[0] = 0x9D, codes[1] = id; \ | |
| 1998 } while (0); | |
| 1999 | |
| 2000 | |
| 2001 static int | |
| 2002 encode_coding_emacs_mule (coding) | |
| 2003 struct coding_system *coding; | |
| 2004 { | |
| 2005 int multibytep = coding->dst_multibyte; | |
| 2006 int *charbuf = coding->charbuf; | |
| 2007 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 2008 unsigned char *dst = coding->destination + coding->produced; | |
| 2009 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 2010 int safe_room = 8; | |
| 2011 int produced_chars = 0; | |
| 2012 Lisp_Object attrs, eol_type, charset_list; | |
| 2013 int c; | |
| 2014 | |
| 2015 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
| 2016 | |
| 2017 while (charbuf < charbuf_end) | |
| 2018 { | |
| 2019 ASSURE_DESTINATION (safe_room); | |
| 2020 c = *charbuf++; | |
| 2021 if (ASCII_CHAR_P (c)) | |
| 2022 EMIT_ONE_ASCII_BYTE (c); | |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
2023 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
2024 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
2025 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
2026 EMIT_ONE_BYTE (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
2027 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2028 else |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2029 { |
| 88365 | 2030 struct charset *charset; |
| 2031 unsigned code; | |
| 2032 int dimension; | |
| 2033 int emacs_mule_id; | |
| 2034 unsigned char leading_codes[2]; | |
| 2035 | |
| 2036 charset = char_charset (c, charset_list, &code); | |
| 2037 if (! charset) | |
| 2038 { | |
| 2039 c = coding->default_char; | |
| 2040 if (ASCII_CHAR_P (c)) | |
| 2041 { | |
| 2042 EMIT_ONE_ASCII_BYTE (c); | |
| 2043 continue; | |
| 2044 } | |
| 2045 charset = char_charset (c, charset_list, &code); | |
| 2046 } | |
| 2047 dimension = CHARSET_DIMENSION (charset); | |
| 2048 emacs_mule_id = CHARSET_EMACS_MULE_ID (charset); | |
| 2049 EMACS_MULE_LEADING_CODES (emacs_mule_id, leading_codes); | |
| 2050 EMIT_ONE_BYTE (leading_codes[0]); | |
| 2051 if (leading_codes[1]) | |
| 2052 EMIT_ONE_BYTE (leading_codes[1]); | |
| 2053 if (dimension == 1) | |
| 2054 EMIT_ONE_BYTE (code); | |
| 2055 else | |
| 2056 { | |
| 2057 EMIT_ONE_BYTE (code >> 8); | |
| 2058 EMIT_ONE_BYTE (code & 0xFF); | |
| 2059 } | |
| 17052 | 2060 } |
| 88365 | 2061 } |
| 2062 coding->result = CODING_RESULT_SUCCESS; | |
| 2063 coding->produced_char += produced_chars; | |
| 2064 coding->produced = dst - coding->destination; | |
| 2065 return 0; | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2066 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2067 |
| 17052 | 2068 |
| 88365 | 2069 /*** 7. ISO2022 handlers ***/ |
| 17052 | 2070 |
| 2071 /* The following note describes the coding system ISO2022 briefly. | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2072 Since the intention of this note is to help understand the |
| 88771 | 2073 functions in this file, some parts are NOT ACCURATE or are OVERLY |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2074 SIMPLIFIED. For thorough understanding, please refer to the |
| 88771 | 2075 original document of ISO2022. This is equivalent to the standard |
| 2076 ECMA-35, obtainable from <URL:http://www.ecma.ch/> (*). | |
| 17052 | 2077 |
| 2078 ISO2022 provides many mechanisms to encode several character sets | |
| 88771 | 2079 in 7-bit and 8-bit environments. For 7-bit environments, all text |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2080 is encoded using bytes less than 128. This may make the encoded |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2081 text a little bit longer, but the text passes more easily through |
| 88771 | 2082 several types of gateway, some of which strip off the MSB (Most |
| 2083 Significant Bit). | |
| 2084 | |
| 2085 There are two kinds of character sets: control character sets and | |
| 2086 graphic character sets. The former contain control characters such | |
| 17052 | 2087 as `newline' and `escape' to provide control functions (control |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2088 functions are also provided by escape sequences). The latter |
| 88771 | 2089 contain graphic characters such as 'A' and '-'. Emacs recognizes |
| 17052 | 2090 two control character sets and many graphic character sets. |
| 2091 | |
| 2092 Graphic character sets are classified into one of the following | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2093 four classes, according to the number of bytes (DIMENSION) and |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2094 number of characters in one dimension (CHARS) of the set: |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2095 - DIMENSION1_CHARS94 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2096 - DIMENSION1_CHARS96 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2097 - DIMENSION2_CHARS94 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2098 - DIMENSION2_CHARS96 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2099 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2100 In addition, each character set is assigned an identification tag, |
| 88771 | 2101 unique for each set, called the "final character" (denoted as <F> |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2102 hereafter). The <F> of each character set is decided by ECMA(*) |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2103 when it is registered in ISO. The code range of <F> is 0x30..0x7F |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2104 (0x30..0x3F are for private use only). |
| 17052 | 2105 |
| 2106 Note (*): ECMA = European Computer Manufacturers Association | |
| 2107 | |
| 88771 | 2108 Here are examples of graphic character sets [NAME(<F>)]: |
| 17052 | 2109 o DIMENSION1_CHARS94 -- ASCII('B'), right-half-of-JISX0201('I'), ... |
| 2110 o DIMENSION1_CHARS96 -- right-half-of-ISO8859-1('A'), ... | |
| 2111 o DIMENSION2_CHARS94 -- GB2312('A'), JISX0208('B'), ... | |
| 2112 o DIMENSION2_CHARS96 -- none for the moment | |
| 2113 | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2114 A code area (1 byte=8 bits) is divided into 4 areas, C0, GL, C1, and GR. |
| 17052 | 2115 C0 [0x00..0x1F] -- control character plane 0 |
| 2116 GL [0x20..0x7F] -- graphic character plane 0 | |
| 2117 C1 [0x80..0x9F] -- control character plane 1 | |
| 2118 GR [0xA0..0xFF] -- graphic character plane 1 | |
| 2119 | |
| 2120 A control character set is directly designated and invoked to C0 or | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2121 C1 by an escape sequence. The most common case is that: |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2122 - ISO646's control character set is designated/invoked to C0, and |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2123 - ISO6429's control character set is designated/invoked to C1, |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2124 and usually these designations/invocations are omitted in encoded |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2125 text. In a 7-bit environment, only C0 can be used, and a control |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2126 character for C1 is encoded by an appropriate escape sequence to |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2127 fit into the environment. All control characters for C1 are |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2128 defined to have corresponding escape sequences. |
| 17052 | 2129 |
| 2130 A graphic character set is at first designated to one of four | |
| 2131 graphic registers (G0 through G3), then these graphic registers are | |
| 2132 invoked to GL or GR. These designations and invocations can be | |
| 2133 done independently. The most common case is that G0 is invoked to | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2134 GL, G1 is invoked to GR, and ASCII is designated to G0. Usually |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2135 these invocations and designations are omitted in encoded text. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2136 In a 7-bit environment, only GL can be used. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2137 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2138 When a graphic character set of CHARS94 is invoked to GL, codes |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2139 0x20 and 0x7F of the GL area work as control characters SPACE and |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2140 DEL respectively, and codes 0xA0 and 0xFF of the GR area should not |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2141 be used. |
| 17052 | 2142 |
| 2143 There are two ways of invocation: locking-shift and single-shift. | |
| 2144 With locking-shift, the invocation lasts until the next different | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2145 invocation, whereas with single-shift, the invocation affects the |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2146 following character only and doesn't affect the locking-shift |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2147 state. Invocations are done by the following control characters or |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2148 escape sequences: |
| 17052 | 2149 |
| 2150 ---------------------------------------------------------------------- | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2151 abbrev function cntrl escape seq description |
| 17052 | 2152 ---------------------------------------------------------------------- |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2153 SI/LS0 (shift-in) 0x0F none invoke G0 into GL |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2154 SO/LS1 (shift-out) 0x0E none invoke G1 into GL |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2155 LS2 (locking-shift-2) none ESC 'n' invoke G2 into GL |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2156 LS3 (locking-shift-3) none ESC 'o' invoke G3 into GL |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2157 LS1R (locking-shift-1 right) none ESC '~' invoke G1 into GR (*) |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2158 LS2R (locking-shift-2 right) none ESC '}' invoke G2 into GR (*) |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2159 LS3R (locking-shift 3 right) none ESC '|' invoke G3 into GR (*) |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2160 SS2 (single-shift-2) 0x8E ESC 'N' invoke G2 for one char |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2161 SS3 (single-shift-3) 0x8F ESC 'O' invoke G3 for one char |
| 17052 | 2162 ---------------------------------------------------------------------- |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2163 (*) These are not used by any known coding system. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2164 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2165 Control characters for these functions are defined by macros |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2166 ISO_CODE_XXX in `coding.h'. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2167 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2168 Designations are done by the following escape sequences: |
| 17052 | 2169 ---------------------------------------------------------------------- |
| 2170 escape sequence description | |
| 2171 ---------------------------------------------------------------------- | |
| 2172 ESC '(' <F> designate DIMENSION1_CHARS94<F> to G0 | |
| 2173 ESC ')' <F> designate DIMENSION1_CHARS94<F> to G1 | |
| 2174 ESC '*' <F> designate DIMENSION1_CHARS94<F> to G2 | |
| 2175 ESC '+' <F> designate DIMENSION1_CHARS94<F> to G3 | |
| 2176 ESC ',' <F> designate DIMENSION1_CHARS96<F> to G0 (*) | |
| 2177 ESC '-' <F> designate DIMENSION1_CHARS96<F> to G1 | |
| 2178 ESC '.' <F> designate DIMENSION1_CHARS96<F> to G2 | |
| 2179 ESC '/' <F> designate DIMENSION1_CHARS96<F> to G3 | |
| 2180 ESC '$' '(' <F> designate DIMENSION2_CHARS94<F> to G0 (**) | |
| 2181 ESC '$' ')' <F> designate DIMENSION2_CHARS94<F> to G1 | |
| 2182 ESC '$' '*' <F> designate DIMENSION2_CHARS94<F> to G2 | |
| 2183 ESC '$' '+' <F> designate DIMENSION2_CHARS94<F> to G3 | |
| 2184 ESC '$' ',' <F> designate DIMENSION2_CHARS96<F> to G0 (*) | |
| 2185 ESC '$' '-' <F> designate DIMENSION2_CHARS96<F> to G1 | |
| 2186 ESC '$' '.' <F> designate DIMENSION2_CHARS96<F> to G2 | |
| 2187 ESC '$' '/' <F> designate DIMENSION2_CHARS96<F> to G3 | |
| 2188 ---------------------------------------------------------------------- | |
| 2189 | |
| 2190 In this list, "DIMENSION1_CHARS94<F>" means a graphic character set | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2191 of dimension 1, chars 94, and final character <F>, etc... |
| 17052 | 2192 |
| 2193 Note (*): Although these designations are not allowed in ISO2022, | |
| 2194 Emacs accepts them on decoding, and produces them on encoding | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2195 CHARS96 character sets in a coding system which is characterized as |
| 17052 | 2196 7-bit environment, non-locking-shift, and non-single-shift. |
| 2197 | |
| 2198 Note (**): If <F> is '@', 'A', or 'B', the intermediate character | |
| 88365 | 2199 '(' must be omitted. We refer to this as "short-form" hereafter. |
| 2200 | |
| 88771 | 2201 Now you may notice that there are a lot of ways of encoding the |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2202 same multilingual text in ISO2022. Actually, there exist many |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2203 coding systems such as Compound Text (used in X11's inter client |
| 88771 | 2204 communication, ISO-2022-JP (used in Japanese Internet), ISO-2022-KR |
| 2205 (used in Korean Internet), EUC (Extended UNIX Code, used in Asian | |
| 17052 | 2206 localized platforms), and all of these are variants of ISO2022. |
| 2207 | |
| 2208 In addition to the above, Emacs handles two more kinds of escape | |
| 2209 sequences: ISO6429's direction specification and Emacs' private | |
| 2210 sequence for specifying character composition. | |
| 2211 | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2212 ISO6429's direction specification takes the following form: |
| 17052 | 2213 o CSI ']' -- end of the current direction |
| 2214 o CSI '0' ']' -- end of the current direction | |
| 2215 o CSI '1' ']' -- start of left-to-right text | |
| 2216 o CSI '2' ']' -- start of right-to-left text | |
| 2217 The control character CSI (0x9B: control sequence introducer) is | |
|
24425
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2218 abbreviated to the escape sequence ESC '[' in a 7-bit environment. |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2219 |
|
61c6b3be1d51
Comment for ISO 2022 encoding mechanism modified.
Kenichi Handa <handa@m17n.org>
parents:
24344
diff
changeset
|
2220 Character composition specification takes the following form: |
| 26847 | 2221 o ESC '0' -- start relative composition |
| 2222 o ESC '1' -- end composition | |
| 2223 o ESC '2' -- start rule-base composition (*) | |
| 2224 o ESC '3' -- start relative composition with alternate chars (**) | |
| 2225 o ESC '4' -- start rule-base composition with alternate chars (**) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2226 Since these are not standard escape sequences of any ISO standard, |
| 88771 | 2227 the use of them with these meanings is restricted to Emacs only. |
| 2228 | |
| 2229 (*) This form is used only in Emacs 20.7 and older versions, | |
| 2230 but newer versions can safely decode it. | |
| 2231 (**) This form is used only in Emacs 21.1 and newer versions, | |
| 2232 and older versions can't decode it. | |
| 2233 | |
| 2234 Here's a list of example usages of these composition escape | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2235 sequences (categorized by `enum composition_method'). |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2236 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2237 COMPOSITION_RELATIVE: |
| 26847 | 2238 ESC 0 CHAR [ CHAR ] ESC 1 |
| 88771 | 2239 COMPOSITION_WITH_RULE: |
| 26847 | 2240 ESC 2 CHAR [ RULE CHAR ] ESC 1 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2241 COMPOSITION_WITH_ALTCHARS: |
| 26847 | 2242 ESC 3 ALTCHAR [ ALTCHAR ] ESC 0 CHAR [ CHAR ] ESC 1 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2243 COMPOSITION_WITH_RULE_ALTCHARS: |
| 26847 | 2244 ESC 4 ALTCHAR [ RULE ALTCHAR ] ESC 0 CHAR [ CHAR ] ESC 1 */ |
| 17052 | 2245 |
| 2246 enum iso_code_class_type iso_code_class[256]; | |
| 2247 | |
| 88365 | 2248 #define SAFE_CHARSET_P(coding, id) \ |
| 2249 ((id) <= (coding)->max_charset_id \ | |
| 2250 && (coding)->safe_charsets[id] >= 0) | |
| 2251 | |
| 2252 | |
| 2253 #define SHIFT_OUT_OK(category) \ | |
| 2254 (CODING_ISO_INITIAL (&coding_categories[category], 1) >= 0) | |
| 2255 | |
| 2256 static void | |
|
88631
780b91d4a7e5
(setup_iso_safe_charsets): Fix arg decl for K&R.
Dave Love <fx@gnu.org>
parents:
88607
diff
changeset
|
2257 setup_iso_safe_charsets (attrs) |
|
780b91d4a7e5
(setup_iso_safe_charsets): Fix arg decl for K&R.
Dave Love <fx@gnu.org>
parents:
88607
diff
changeset
|
2258 Lisp_Object attrs; |
| 88365 | 2259 { |
| 2260 Lisp_Object charset_list, safe_charsets; | |
| 2261 Lisp_Object request; | |
| 2262 Lisp_Object reg_usage; | |
| 2263 Lisp_Object tail; | |
| 2264 int reg94, reg96; | |
| 2265 int flags = XINT (AREF (attrs, coding_attr_iso_flags)); | |
| 2266 int max_charset_id; | |
| 2267 | |
| 2268 charset_list = CODING_ATTR_CHARSET_LIST (attrs); | |
| 2269 if ((flags & CODING_ISO_FLAG_FULL_SUPPORT) | |
| 2270 && ! EQ (charset_list, Viso_2022_charset_list)) | |
| 2271 { | |
| 2272 CODING_ATTR_CHARSET_LIST (attrs) | |
| 2273 = charset_list = Viso_2022_charset_list; | |
| 2274 ASET (attrs, coding_attr_safe_charsets, Qnil); | |
| 2275 } | |
| 2276 | |
| 2277 if (STRINGP (AREF (attrs, coding_attr_safe_charsets))) | |
| 2278 return; | |
| 2279 | |
| 2280 max_charset_id = 0; | |
| 2281 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) | |
| 2282 { | |
| 2283 int id = XINT (XCAR (tail)); | |
| 2284 if (max_charset_id < id) | |
| 2285 max_charset_id = id; | |
| 2286 } | |
| 2287 | |
| 2288 safe_charsets = Fmake_string (make_number (max_charset_id + 1), | |
| 2289 make_number (255)); | |
| 2290 request = AREF (attrs, coding_attr_iso_request); | |
| 2291 reg_usage = AREF (attrs, coding_attr_iso_usage); | |
| 2292 reg94 = XINT (XCAR (reg_usage)); | |
| 2293 reg96 = XINT (XCDR (reg_usage)); | |
| 2294 | |
| 2295 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) | |
| 2296 { | |
| 2297 Lisp_Object id; | |
| 2298 Lisp_Object reg; | |
| 2299 struct charset *charset; | |
| 2300 | |
| 2301 id = XCAR (tail); | |
| 2302 charset = CHARSET_FROM_ID (XINT (id)); | |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2303 reg = Fcdr (Fassq (id, request)); |
| 88365 | 2304 if (! NILP (reg)) |
| 2305 XSTRING (safe_charsets)->data[XINT (id)] = XINT (reg); | |
| 2306 else if (charset->iso_chars_96) | |
| 2307 { | |
| 2308 if (reg96 < 4) | |
| 2309 XSTRING (safe_charsets)->data[XINT (id)] = reg96; | |
| 2310 } | |
| 2311 else | |
| 2312 { | |
| 2313 if (reg94 < 4) | |
| 2314 XSTRING (safe_charsets)->data[XINT (id)] = reg94; | |
| 2315 } | |
| 2316 } | |
| 2317 ASET (attrs, coding_attr_safe_charsets, safe_charsets); | |
| 2318 } | |
| 2319 | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2320 |
| 17052 | 2321 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". |
| 88365 | 2322 Check if a text is encoded in ISO2022. If it is, returns an |
| 17052 | 2323 integer in which appropriate flag bits any of: |
| 88365 | 2324 CATEGORY_MASK_ISO_7 |
| 2325 CATEGORY_MASK_ISO_7_TIGHT | |
| 2326 CATEGORY_MASK_ISO_8_1 | |
| 2327 CATEGORY_MASK_ISO_8_2 | |
| 2328 CATEGORY_MASK_ISO_7_ELSE | |
| 2329 CATEGORY_MASK_ISO_8_ELSE | |
| 17052 | 2330 are set. If a code which should never appear in ISO2022 is found, |
| 2331 returns 0. */ | |
| 2332 | |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
2333 static int |
| 88365 | 2334 detect_coding_iso_2022 (coding, mask) |
| 2335 struct coding_system *coding; | |
| 2336 int *mask; | |
| 17052 | 2337 { |
| 88365 | 2338 unsigned char *src = coding->source, *src_base = src; |
| 2339 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 2340 int multibytep = coding->src_multibyte; | |
| 2341 int mask_iso = CATEGORY_MASK_ISO; | |
| 2342 int mask_found = 0, mask_8bit_found = 0; | |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2343 int reg[4], shift_out = 0, single_shifting = 0; |
| 88365 | 2344 int id; |
| 2345 int c, c1; | |
| 2346 int consumed_chars = 0; | |
| 2347 int i; | |
| 2348 | |
| 2349 for (i = coding_category_iso_7; i <= coding_category_iso_8_else; i++) | |
| 2350 { | |
| 2351 struct coding_system *this = &(coding_categories[i]); | |
| 2352 Lisp_Object attrs, val; | |
| 2353 | |
| 2354 attrs = CODING_ID_ATTRS (this->id); | |
| 2355 if (CODING_ISO_FLAGS (this) & CODING_ISO_FLAG_FULL_SUPPORT | |
| 2356 && ! EQ (CODING_ATTR_SAFE_CHARSETS (attrs), Viso_2022_charset_list)) | |
| 2357 setup_iso_safe_charsets (attrs); | |
| 2358 val = CODING_ATTR_SAFE_CHARSETS (attrs); | |
| 2359 this->max_charset_id = XSTRING (val)->size - 1; | |
| 2360 this->safe_charsets = (char *) XSTRING (val)->data; | |
| 2361 } | |
| 2362 | |
| 2363 /* A coding system of this category is always ASCII compatible. */ | |
| 2364 src += coding->head_ascii; | |
| 2365 | |
| 2366 reg[0] = charset_ascii, reg[1] = reg[2] = reg[3] = -1; | |
| 2367 while (mask_iso && src < src_end) | |
| 2368 { | |
| 2369 ONE_MORE_BYTE (c); | |
| 17052 | 2370 switch (c) |
| 2371 { | |
| 2372 case ISO_CODE_ESC: | |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2373 if (inhibit_iso_escape_detection) |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2374 break; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2375 single_shifting = 0; |
| 88365 | 2376 ONE_MORE_BYTE (c); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2377 if (c >= '(' && c <= '/') |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2378 { |
|
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2379 /* Designation sequence for a charset of dimension 1. */ |
| 88365 | 2380 ONE_MORE_BYTE (c1); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2381 if (c1 < ' ' || c1 >= 0x80 |
| 88365 | 2382 || (id = iso_charset_table[0][c >= ','][c1]) < 0) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2383 /* Invalid designation sequence. Just ignore. */ |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2384 break; |
| 88365 | 2385 reg[(c - '(') % 4] = id; |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2386 } |
|
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2387 else if (c == '$') |
| 17052 | 2388 { |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2389 /* Designation sequence for a charset of dimension 2. */ |
| 88365 | 2390 ONE_MORE_BYTE (c); |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2391 if (c >= '@' && c <= 'B') |
|
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2392 /* Designation for JISX0208.1978, GB2312, or JISX0208. */ |
| 88365 | 2393 reg[0] = id = iso_charset_table[1][0][c]; |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2394 else if (c >= '(' && c <= '/') |
|
17320
9d15bec5f47e
(detect_coding_iso2022, detect_coding_mask): Ignore
Kenichi Handa <handa@m17n.org>
parents:
17304
diff
changeset
|
2395 { |
| 88365 | 2396 ONE_MORE_BYTE (c1); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2397 if (c1 < ' ' || c1 >= 0x80 |
| 88365 | 2398 || (id = iso_charset_table[1][c >= ','][c1]) < 0) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2399 /* Invalid designation sequence. Just ignore. */ |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2400 break; |
| 88365 | 2401 reg[(c - '(') % 4] = id; |
|
17320
9d15bec5f47e
(detect_coding_iso2022, detect_coding_mask): Ignore
Kenichi Handa <handa@m17n.org>
parents:
17304
diff
changeset
|
2402 } |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2403 else |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2404 /* Invalid designation sequence. Just ignore. */ |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2405 break; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2406 } |
|
23116
6736da064f4a
(detect_coding_iso2022): Handle ESC N and ESC O
Kenichi Handa <handa@m17n.org>
parents:
23089
diff
changeset
|
2407 else if (c == 'N' || c == 'O') |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2408 { |
|
23116
6736da064f4a
(detect_coding_iso2022): Handle ESC N and ESC O
Kenichi Handa <handa@m17n.org>
parents:
23089
diff
changeset
|
2409 /* ESC <Fe> for SS2 or SS3. */ |
| 88365 | 2410 mask_iso &= CATEGORY_MASK_ISO_7_ELSE; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2411 break; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2412 } |
| 26847 | 2413 else if (c >= '0' && c <= '4') |
| 2414 { | |
| 2415 /* ESC <Fp> for start/end composition. */ | |
| 88365 | 2416 mask_found |= CATEGORY_MASK_ISO; |
| 26847 | 2417 break; |
| 2418 } | |
|
19134
8fa6e23f8d22
(detect_coding_iso2022): Do not exclude posibility of
Kenichi Handa <handa@m17n.org>
parents:
19118
diff
changeset
|
2419 else |
| 88365 | 2420 { |
| 2421 /* Invalid escape sequence. */ | |
| 2422 mask_iso &= ~CATEGORY_MASK_ISO_ESCAPE; | |
| 2423 break; | |
| 2424 } | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2425 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2426 /* We found a valid designation sequence for CHARSET. */ |
| 88365 | 2427 mask_iso &= ~CATEGORY_MASK_ISO_8BIT; |
| 2428 if (SAFE_CHARSET_P (&coding_categories[coding_category_iso_7], | |
| 2429 id)) | |
| 2430 mask_found |= CATEGORY_MASK_ISO_7; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2431 else |
| 88365 | 2432 mask_iso &= ~CATEGORY_MASK_ISO_7; |
| 2433 if (SAFE_CHARSET_P (&coding_categories[coding_category_iso_7_tight], | |
| 2434 id)) | |
| 2435 mask_found |= CATEGORY_MASK_ISO_7_TIGHT; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2436 else |
| 88365 | 2437 mask_iso &= ~CATEGORY_MASK_ISO_7_TIGHT; |
| 2438 if (SAFE_CHARSET_P (&coding_categories[coding_category_iso_7_else], | |
| 2439 id)) | |
| 2440 mask_found |= CATEGORY_MASK_ISO_7_ELSE; | |
|
23116
6736da064f4a
(detect_coding_iso2022): Handle ESC N and ESC O
Kenichi Handa <handa@m17n.org>
parents:
23089
diff
changeset
|
2441 else |
| 88365 | 2442 mask_iso &= ~CATEGORY_MASK_ISO_7_ELSE; |
| 2443 if (SAFE_CHARSET_P (&coding_categories[coding_category_iso_8_else], | |
| 2444 id)) | |
| 2445 mask_found |= CATEGORY_MASK_ISO_8_ELSE; | |
|
23116
6736da064f4a
(detect_coding_iso2022): Handle ESC N and ESC O
Kenichi Handa <handa@m17n.org>
parents:
23089
diff
changeset
|
2446 else |
| 88365 | 2447 mask_iso &= ~CATEGORY_MASK_ISO_8_ELSE; |
| 17052 | 2448 break; |
| 2449 | |
| 2450 case ISO_CODE_SO: | |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2451 if (inhibit_iso_escape_detection) |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2452 break; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2453 single_shifting = 0; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2454 if (shift_out == 0 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2455 && (reg[1] >= 0 |
| 88365 | 2456 || SHIFT_OUT_OK (coding_category_iso_7_else) |
| 2457 || SHIFT_OUT_OK (coding_category_iso_8_else))) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2458 { |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2459 /* Locking shift out. */ |
| 88365 | 2460 mask_iso &= ~CATEGORY_MASK_ISO_7BIT; |
| 2461 mask_found |= CATEGORY_MASK_ISO_ELSE; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2462 } |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
2463 break; |
| 88365 | 2464 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2465 case ISO_CODE_SI: |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2466 if (inhibit_iso_escape_detection) |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2467 break; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2468 single_shifting = 0; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2469 if (shift_out == 1) |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2470 { |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2471 /* Locking shift in. */ |
| 88365 | 2472 mask_iso &= ~CATEGORY_MASK_ISO_7BIT; |
| 2473 mask_found |= CATEGORY_MASK_ISO_ELSE; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2474 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2475 break; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2476 |
| 17052 | 2477 case ISO_CODE_CSI: |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2478 single_shifting = 0; |
| 17052 | 2479 case ISO_CODE_SS2: |
| 2480 case ISO_CODE_SS3: | |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2481 { |
| 88365 | 2482 int newmask = CATEGORY_MASK_ISO_8_ELSE; |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2483 |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
2484 mask_8bit_found = 1; |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2485 if (inhibit_iso_escape_detection) |
|
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
2486 break; |
|
20150
402b6e5f4b58
(encode_designation_at_bol): Fix bug of finding graphic
Kenichi Handa <handa@m17n.org>
parents:
20105
diff
changeset
|
2487 if (c != ISO_CODE_CSI) |
|
402b6e5f4b58
(encode_designation_at_bol): Fix bug of finding graphic
Kenichi Handa <handa@m17n.org>
parents:
20105
diff
changeset
|
2488 { |
| 88365 | 2489 if (CODING_ISO_FLAGS (&coding_categories[coding_category_iso_8_1]) |
| 2490 & CODING_ISO_FLAG_SINGLE_SHIFT) | |
| 2491 newmask |= CATEGORY_MASK_ISO_8_1; | |
| 2492 if (CODING_ISO_FLAGS (&coding_categories[coding_category_iso_8_2]) | |
| 2493 & CODING_ISO_FLAG_SINGLE_SHIFT) | |
| 2494 newmask |= CATEGORY_MASK_ISO_8_2; | |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2495 single_shifting = 1; |
|
20150
402b6e5f4b58
(encode_designation_at_bol): Fix bug of finding graphic
Kenichi Handa <handa@m17n.org>
parents:
20105
diff
changeset
|
2496 } |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2497 if (VECTORP (Vlatin_extra_code_table) |
|
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2498 && !NILP (XVECTOR (Vlatin_extra_code_table)->contents[c])) |
|
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2499 { |
| 88365 | 2500 if (CODING_ISO_FLAGS (&coding_categories[coding_category_iso_8_1]) |
| 2501 & CODING_ISO_FLAG_LATIN_EXTRA) | |
| 2502 newmask |= CATEGORY_MASK_ISO_8_1; | |
| 2503 if (CODING_ISO_FLAGS (&coding_categories[coding_category_iso_8_2]) | |
| 2504 & CODING_ISO_FLAG_LATIN_EXTRA) | |
| 2505 newmask |= CATEGORY_MASK_ISO_8_2; | |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2506 } |
| 88365 | 2507 mask_iso &= newmask; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2508 mask_found |= newmask; |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2509 } |
|
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2510 break; |
| 17052 | 2511 |
| 2512 default: | |
| 2513 if (c < 0x80) | |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2514 { |
|
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2515 single_shifting = 0; |
|
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2516 break; |
|
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2517 } |
| 17052 | 2518 else if (c < 0xA0) |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
2519 { |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2520 single_shifting = 0; |
| 88365 | 2521 mask_8bit_found = 1; |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2522 if (VECTORP (Vlatin_extra_code_table) |
|
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2523 && !NILP (XVECTOR (Vlatin_extra_code_table)->contents[c])) |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
2524 { |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2525 int newmask = 0; |
|
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2526 |
| 88365 | 2527 if (CODING_ISO_FLAGS (&coding_categories[coding_category_iso_8_1]) |
| 2528 & CODING_ISO_FLAG_LATIN_EXTRA) | |
| 2529 newmask |= CATEGORY_MASK_ISO_8_1; | |
| 2530 if (CODING_ISO_FLAGS (&coding_categories[coding_category_iso_8_2]) | |
| 2531 & CODING_ISO_FLAG_LATIN_EXTRA) | |
| 2532 newmask |= CATEGORY_MASK_ISO_8_2; | |
| 2533 mask_iso &= newmask; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2534 mask_found |= newmask; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
2535 } |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2536 else |
|
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
2537 return 0; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
2538 } |
| 17052 | 2539 else |
| 2540 { | |
| 88365 | 2541 mask_iso &= ~(CATEGORY_MASK_ISO_7BIT |
| 2542 | CATEGORY_MASK_ISO_7_ELSE); | |
| 2543 mask_found |= CATEGORY_MASK_ISO_8_1; | |
| 2544 mask_8bit_found = 1; | |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2545 /* Check the length of succeeding codes of the range |
|
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2546 0xA0..0FF. If the byte length is odd, we exclude |
| 88365 | 2547 CATEGORY_MASK_ISO_8_2. We can check this only |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2548 when we are not single shifting. */ |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2549 if (!single_shifting |
| 88365 | 2550 && mask_iso & CATEGORY_MASK_ISO_8_2) |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2551 { |
|
29299
b33b38d81020
(detect_coding_iso2022): Fix code for checking
Kenichi Handa <handa@m17n.org>
parents:
29275
diff
changeset
|
2552 int i = 1; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2553 while (src < src_end) |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2554 { |
| 88365 | 2555 ONE_MORE_BYTE (c); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2556 if (c < 0xA0) |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2557 break; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2558 i++; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2559 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2560 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2561 if (i & 1 && src < src_end) |
| 88365 | 2562 mask_iso &= ~CATEGORY_MASK_ISO_8_2; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2563 else |
| 88365 | 2564 mask_found |= CATEGORY_MASK_ISO_8_2; |
|
23088
45c36d636f66
(detect_coding_iso2022): Don't check the byte length of
Kenichi Handa <handa@m17n.org>
parents:
23082
diff
changeset
|
2565 } |
| 17052 | 2566 } |
| 2567 break; | |
| 2568 } | |
| 2569 } | |
| 88365 | 2570 no_more_source: |
| 2571 if (!mask_iso) | |
| 2572 { | |
| 2573 *mask &= ~CATEGORY_MASK_ISO; | |
| 2574 return 0; | |
| 2575 } | |
| 2576 if (!mask_found) | |
| 2577 return 0; | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
2578 *mask &= ~CATEGORY_MASK_ISO; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
2579 *mask |= mask_iso & mask_found; |
| 88365 | 2580 if (! mask_8bit_found) |
| 2581 *mask &= ~(CATEGORY_MASK_ISO_8BIT | CATEGORY_MASK_ISO_8_ELSE); | |
| 2582 return 1; | |
| 17052 | 2583 } |
| 2584 | |
| 2585 | |
| 2586 /* Set designation state into CODING. */ | |
| 88365 | 2587 #define DECODE_DESIGNATION(reg, dim, chars_96, final) \ |
| 2588 do { \ | |
| 2589 int id, prev; \ | |
| 2590 \ | |
| 2591 if (final < '0' || final >= 128 \ | |
| 2592 || ((id = ISO_CHARSET_TABLE (dim, chars_96, final)) < 0) \ | |
| 2593 || !SAFE_CHARSET_P (coding, id)) \ | |
| 2594 { \ | |
| 2595 CODING_ISO_DESIGNATION (coding, reg) = -2; \ | |
| 2596 goto invalid_code; \ | |
| 2597 } \ | |
| 2598 prev = CODING_ISO_DESIGNATION (coding, reg); \ | |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2599 if (id == charset_jisx0201_roman) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2600 { \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2601 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_USE_ROMAN) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2602 id = charset_ascii; \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2603 } \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2604 else if (id == charset_jisx0208_1978) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2605 { \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2606 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_USE_OLDJIS) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2607 id = charset_jisx0208; \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
2608 } \ |
| 88365 | 2609 CODING_ISO_DESIGNATION (coding, reg) = id; \ |
| 2610 /* If there was an invalid designation to REG previously, and this \ | |
| 2611 designation is ASCII to REG, we should keep this designation \ | |
| 2612 sequence. */ \ | |
| 2613 if (prev == -2 && id == charset_ascii) \ | |
| 2614 goto invalid_code; \ | |
| 17052 | 2615 } while (0) |
| 2616 | |
| 88365 | 2617 |
| 2618 #define MAYBE_FINISH_COMPOSITION() \ | |
| 2619 do { \ | |
| 2620 int i; \ | |
| 2621 if (composition_state == COMPOSING_NO) \ | |
| 2622 break; \ | |
| 2623 /* It is assured that we have enough room for producing \ | |
| 2624 characters stored in the table `components'. */ \ | |
| 2625 if (charbuf + component_idx > charbuf_end) \ | |
| 2626 goto no_more_source; \ | |
| 2627 composition_state = COMPOSING_NO; \ | |
| 2628 if (method == COMPOSITION_RELATIVE \ | |
| 2629 || method == COMPOSITION_WITH_ALTCHARS) \ | |
| 2630 { \ | |
| 2631 for (i = 0; i < component_idx; i++) \ | |
| 2632 *charbuf++ = components[i]; \ | |
| 2633 char_offset += component_idx; \ | |
| 2634 } \ | |
| 2635 else \ | |
| 2636 { \ | |
| 2637 for (i = 0; i < component_idx; i += 2) \ | |
| 2638 *charbuf++ = components[i]; \ | |
| 2639 char_offset += (component_idx / 2) + 1; \ | |
| 2640 } \ | |
| 2641 } while (0) | |
| 2642 | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
2643 |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2644 /* Handle composition start sequence ESC 0, ESC 2, ESC 3, or ESC 4. |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2645 ESC 0 : relative composition : ESC 0 CHAR ... ESC 1 |
|
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2646 ESC 2 : rulebase composition : ESC 2 CHAR RULE CHAR RULE ... CHAR ESC 1 |
| 88365 | 2647 ESC 3 : altchar composition : ESC 3 CHAR ... ESC 0 CHAR ... ESC 1 |
| 2648 ESC 4 : alt&rule composition : ESC 4 CHAR RULE ... CHAR ESC 0 CHAR ... ESC 1 | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
2649 */ |
| 26847 | 2650 |
| 88365 | 2651 #define DECODE_COMPOSITION_START(c1) \ |
| 26847 | 2652 do { \ |
| 88365 | 2653 if (c1 == '0' \ |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2654 && composition_state == COMPOSING_COMPONENT_RULE) \ |
| 26847 | 2655 { \ |
| 88365 | 2656 component_len = component_idx; \ |
| 2657 composition_state = COMPOSING_CHAR; \ | |
| 26847 | 2658 } \ |
| 2659 else \ | |
| 2660 { \ | |
| 88365 | 2661 unsigned char *p; \ |
| 2662 \ | |
| 2663 MAYBE_FINISH_COMPOSITION (); \ | |
| 2664 if (charbuf + MAX_COMPOSITION_COMPONENTS > charbuf_end) \ | |
| 2665 goto no_more_source; \ | |
| 2666 for (p = src; p < src_end - 1; p++) \ | |
| 2667 if (*p == ISO_CODE_ESC && p[1] == '1') \ | |
| 2668 break; \ | |
| 2669 if (p == src_end - 1) \ | |
| 2670 { \ | |
| 2671 if (coding->mode & CODING_MODE_LAST_BLOCK) \ | |
| 2672 goto invalid_code; \ | |
| 2673 goto no_more_source; \ | |
| 2674 } \ | |
| 2675 \ | |
| 2676 /* This is surely the start of a composition. */ \ | |
| 2677 method = (c1 == '0' ? COMPOSITION_RELATIVE \ | |
| 2678 : c1 == '2' ? COMPOSITION_WITH_RULE \ | |
| 2679 : c1 == '3' ? COMPOSITION_WITH_ALTCHARS \ | |
| 2680 : COMPOSITION_WITH_RULE_ALTCHARS); \ | |
| 2681 composition_state = (c1 <= '2' ? COMPOSING_CHAR \ | |
| 2682 : COMPOSING_COMPONENT_CHAR); \ | |
| 2683 component_idx = component_len = 0; \ | |
| 26847 | 2684 } \ |
| 2685 } while (0) | |
| 2686 | |
| 88365 | 2687 |
| 2688 /* Handle compositoin end sequence ESC 1. */ | |
| 2689 | |
| 2690 #define DECODE_COMPOSITION_END() \ | |
| 2691 do { \ | |
| 2692 int nchars = (component_len > 0 ? component_idx - component_len \ | |
| 2693 : method == COMPOSITION_RELATIVE ? component_idx \ | |
| 2694 : (component_idx + 1) / 2); \ | |
| 2695 int i; \ | |
| 2696 int *saved_charbuf = charbuf; \ | |
| 2697 \ | |
| 2698 ADD_COMPOSITION_DATA (charbuf, method, nchars); \ | |
| 2699 if (method != COMPOSITION_RELATIVE) \ | |
| 2700 { \ | |
| 2701 if (component_len == 0) \ | |
| 2702 for (i = 0; i < component_idx; i++) \ | |
| 2703 *charbuf++ = components[i]; \ | |
| 2704 else \ | |
| 2705 for (i = 0; i < component_len; i++) \ | |
| 2706 *charbuf++ = components[i]; \ | |
| 2707 *saved_charbuf = saved_charbuf - charbuf; \ | |
| 2708 } \ | |
| 2709 if (method == COMPOSITION_WITH_RULE) \ | |
| 2710 for (i = 0; i < component_idx; i += 2, char_offset++) \ | |
| 2711 *charbuf++ = components[i]; \ | |
| 2712 else \ | |
| 2713 for (i = component_len; i < component_idx; i++, char_offset++) \ | |
| 2714 *charbuf++ = components[i]; \ | |
| 2715 coding->annotated = 1; \ | |
| 2716 composition_state = COMPOSING_NO; \ | |
| 2717 } while (0) | |
| 2718 | |
| 2719 | |
| 26847 | 2720 /* Decode a composition rule from the byte C1 (and maybe one more byte |
| 2721 from SRC) and store one encoded composition rule in | |
| 2722 coding->cmp_data. */ | |
| 2723 | |
| 2724 #define DECODE_COMPOSITION_RULE(c1) \ | |
| 2725 do { \ | |
| 2726 (c1) -= 32; \ | |
| 2727 if (c1 < 81) /* old format (before ver.21) */ \ | |
| 2728 { \ | |
| 2729 int gref = (c1) / 9; \ | |
| 2730 int nref = (c1) % 9; \ | |
| 2731 if (gref == 4) gref = 10; \ | |
| 2732 if (nref == 4) nref = 10; \ | |
| 88365 | 2733 c1 = COMPOSITION_ENCODE_RULE (gref, nref); \ |
| 26847 | 2734 } \ |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2735 else if (c1 < 93) /* new format (after ver.21) */ \ |
| 26847 | 2736 { \ |
| 2737 ONE_MORE_BYTE (c2); \ | |
| 88365 | 2738 c1 = COMPOSITION_ENCODE_RULE (c1 - 81, c2 - 32); \ |
| 26847 | 2739 } \ |
| 88365 | 2740 else \ |
| 2741 c1 = 0; \ | |
| 26847 | 2742 } while (0) |
| 2743 | |
| 2744 | |
| 17052 | 2745 /* See the above "GENERAL NOTES on `decode_coding_XXX ()' functions". */ |
| 2746 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2747 static void |
| 88365 | 2748 decode_coding_iso_2022 (coding) |
| 17052 | 2749 struct coding_system *coding; |
| 2750 { | |
| 88365 | 2751 unsigned char *src = coding->source + coding->consumed; |
| 2752 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 2753 unsigned char *src_base; | |
| 2754 int *charbuf = coding->charbuf; | |
| 2755 int *charbuf_end = charbuf + coding->charbuf_size - 4; | |
| 2756 int consumed_chars = 0, consumed_chars_base; | |
| 2757 int char_offset = 0; | |
| 2758 int multibytep = coding->src_multibyte; | |
| 17052 | 2759 /* Charsets invoked to graphic plane 0 and 1 respectively. */ |
| 88365 | 2760 int charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); |
| 2761 int charset_id_1 = CODING_ISO_INVOKED_CHARSET (coding, 1); | |
| 2762 struct charset *charset; | |
| 2763 int c; | |
| 2764 /* For handling composition sequence. */ | |
| 2765 #define COMPOSING_NO 0 | |
| 2766 #define COMPOSING_CHAR 1 | |
| 2767 #define COMPOSING_RULE 2 | |
| 2768 #define COMPOSING_COMPONENT_CHAR 3 | |
| 2769 #define COMPOSING_COMPONENT_RULE 4 | |
| 2770 | |
| 2771 int composition_state = COMPOSING_NO; | |
| 2772 enum composition_method method; | |
| 2773 int components[MAX_COMPOSITION_COMPONENTS * 2 + 1]; | |
| 2774 int component_idx; | |
| 2775 int component_len; | |
| 2776 Lisp_Object attrs, eol_type, charset_list; | |
| 2777 | |
| 2778 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
| 2779 setup_iso_safe_charsets (attrs); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2780 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2781 while (1) |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2782 { |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2783 int c1, c2; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2784 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2785 src_base = src; |
| 88365 | 2786 consumed_chars_base = consumed_chars; |
| 2787 | |
| 2788 if (charbuf >= charbuf_end) | |
| 2789 break; | |
| 2790 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2791 ONE_MORE_BYTE (c1); |
| 17052 | 2792 |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
2793 /* We produce at most one character. */ |
| 17052 | 2794 switch (iso_code_class [c1]) |
| 2795 { | |
| 2796 case ISO_0x20_or_0x7F: | |
| 88365 | 2797 if (composition_state != COMPOSING_NO) |
| 26847 | 2798 { |
| 88365 | 2799 if (composition_state == COMPOSING_RULE |
| 2800 || composition_state == COMPOSING_COMPONENT_RULE) | |
| 2801 { | |
| 2802 DECODE_COMPOSITION_RULE (c1); | |
| 2803 components[component_idx++] = c1; | |
| 2804 composition_state--; | |
| 2805 continue; | |
| 2806 } | |
| 26847 | 2807 } |
| 88365 | 2808 if (charset_id_0 < 0 |
| 2809 || ! CHARSET_ISO_CHARS_96 (CHARSET_FROM_ID (charset_id_0))) | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2810 /* This is SPACE or DEL. */ |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2811 charset = CHARSET_FROM_ID (charset_ascii); |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2812 else |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2813 charset = CHARSET_FROM_ID (charset_id_0); |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2814 break; |
| 17052 | 2815 |
| 2816 case ISO_graphic_plane_0: | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2817 if (composition_state != COMPOSING_NO) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2818 { |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2819 if (composition_state == COMPOSING_RULE |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2820 || composition_state == COMPOSING_COMPONENT_RULE) |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2821 { |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2822 DECODE_COMPOSITION_RULE (c1); |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2823 components[component_idx++] = c1; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2824 composition_state--; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2825 continue; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
2826 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2827 } |
| 88365 | 2828 charset = CHARSET_FROM_ID (charset_id_0); |
| 17052 | 2829 break; |
| 2830 | |
| 2831 case ISO_0xA0_or_0xFF: | |
| 88365 | 2832 if (charset_id_1 < 0 |
| 2833 || ! CHARSET_ISO_CHARS_96 (CHARSET_FROM_ID (charset_id_1)) | |
| 2834 || CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) | |
| 2835 goto invalid_code; | |
| 17052 | 2836 /* This is a graphic character, we fall down ... */ |
| 2837 | |
| 2838 case ISO_graphic_plane_1: | |
| 88365 | 2839 if (charset_id_1 < 0) |
| 2840 goto invalid_code; | |
| 2841 charset = CHARSET_FROM_ID (charset_id_1); | |
| 17052 | 2842 break; |
| 2843 | |
| 88365 | 2844 case ISO_carriage_return: |
| 2845 if (c1 == '\r') | |
| 2846 { | |
| 2847 if (EQ (eol_type, Qdos)) | |
| 2848 { | |
| 2849 if (src == src_end) | |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
2850 { |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
2851 coding->result = CODING_RESULT_INSUFFICIENT_SRC; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
2852 goto no_more_source; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
2853 } |
| 88365 | 2854 if (*src == '\n') |
| 2855 ONE_MORE_BYTE (c1); | |
| 2856 } | |
| 2857 else if (EQ (eol_type, Qmac)) | |
| 2858 c1 = '\n'; | |
| 2859 } | |
| 2860 /* fall through */ | |
| 2861 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2862 case ISO_control_0: |
| 88365 | 2863 MAYBE_FINISH_COMPOSITION (); |
| 2864 charset = CHARSET_FROM_ID (charset_ascii); | |
| 17052 | 2865 break; |
| 2866 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2867 case ISO_control_1: |
| 88365 | 2868 MAYBE_FINISH_COMPOSITION (); |
| 2869 goto invalid_code; | |
| 17052 | 2870 |
| 2871 case ISO_shift_out: | |
| 88365 | 2872 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LOCKING_SHIFT) |
| 2873 || CODING_ISO_DESIGNATION (coding, 1) < 0) | |
| 2874 goto invalid_code; | |
| 2875 CODING_ISO_INVOCATION (coding, 0) = 1; | |
| 2876 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2877 continue; |
| 17052 | 2878 |
| 2879 case ISO_shift_in: | |
| 88365 | 2880 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LOCKING_SHIFT)) |
| 2881 goto invalid_code; | |
| 2882 CODING_ISO_INVOCATION (coding, 0) = 0; | |
| 2883 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2884 continue; |
| 17052 | 2885 |
| 2886 case ISO_single_shift_2_7: | |
| 2887 case ISO_single_shift_2: | |
| 88365 | 2888 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT)) |
| 2889 goto invalid_code; | |
| 17052 | 2890 /* SS2 is handled as an escape sequence of ESC 'N' */ |
| 2891 c1 = 'N'; | |
| 2892 goto label_escape_sequence; | |
| 2893 | |
| 2894 case ISO_single_shift_3: | |
| 88365 | 2895 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT)) |
| 2896 goto invalid_code; | |
| 17052 | 2897 /* SS2 is handled as an escape sequence of ESC 'O' */ |
| 2898 c1 = 'O'; | |
| 2899 goto label_escape_sequence; | |
| 2900 | |
| 2901 case ISO_control_sequence_introducer: | |
| 2902 /* CSI is handled as an escape sequence of ESC '[' ... */ | |
| 2903 c1 = '['; | |
| 2904 goto label_escape_sequence; | |
| 2905 | |
| 2906 case ISO_escape: | |
| 2907 ONE_MORE_BYTE (c1); | |
| 2908 label_escape_sequence: | |
| 88365 | 2909 /* Escape sequences handled here are invocation, |
| 17052 | 2910 designation, direction specification, and character |
| 2911 composition specification. */ | |
| 2912 switch (c1) | |
| 2913 { | |
| 2914 case '&': /* revision of following character set */ | |
| 2915 ONE_MORE_BYTE (c1); | |
| 2916 if (!(c1 >= '@' && c1 <= '~')) | |
| 88365 | 2917 goto invalid_code; |
| 17052 | 2918 ONE_MORE_BYTE (c1); |
| 2919 if (c1 != ISO_CODE_ESC) | |
| 88365 | 2920 goto invalid_code; |
| 17052 | 2921 ONE_MORE_BYTE (c1); |
| 2922 goto label_escape_sequence; | |
| 2923 | |
| 2924 case '$': /* designation of 2-byte character set */ | |
| 88365 | 2925 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DESIGNATION)) |
| 2926 goto invalid_code; | |
| 17052 | 2927 ONE_MORE_BYTE (c1); |
| 2928 if (c1 >= '@' && c1 <= 'B') | |
| 2929 { /* designation of JISX0208.1978, GB2312.1980, | |
|
23339
2da87b489590
(check_composing_code): Fix previous change. Now it
Kenichi Handa <handa@m17n.org>
parents:
23325
diff
changeset
|
2930 or JISX0208.1980 */ |
| 88365 | 2931 DECODE_DESIGNATION (0, 2, 0, c1); |
| 17052 | 2932 } |
| 2933 else if (c1 >= 0x28 && c1 <= 0x2B) | |
| 2934 { /* designation of DIMENSION2_CHARS94 character set */ | |
| 2935 ONE_MORE_BYTE (c2); | |
| 88365 | 2936 DECODE_DESIGNATION (c1 - 0x28, 2, 0, c2); |
| 17052 | 2937 } |
| 2938 else if (c1 >= 0x2C && c1 <= 0x2F) | |
| 2939 { /* designation of DIMENSION2_CHARS96 character set */ | |
| 2940 ONE_MORE_BYTE (c2); | |
| 88365 | 2941 DECODE_DESIGNATION (c1 - 0x2C, 2, 1, c2); |
| 17052 | 2942 } |
| 2943 else | |
| 88365 | 2944 goto invalid_code; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2945 /* We must update these variables now. */ |
| 88365 | 2946 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); |
| 2947 charset_id_1 = CODING_ISO_INVOKED_CHARSET (coding, 1); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2948 continue; |
| 17052 | 2949 |
| 2950 case 'n': /* invocation of locking-shift-2 */ | |
| 88365 | 2951 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LOCKING_SHIFT) |
| 2952 || CODING_ISO_DESIGNATION (coding, 2) < 0) | |
| 2953 goto invalid_code; | |
| 2954 CODING_ISO_INVOCATION (coding, 0) = 2; | |
| 2955 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2956 continue; |
| 17052 | 2957 |
| 2958 case 'o': /* invocation of locking-shift-3 */ | |
| 88365 | 2959 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LOCKING_SHIFT) |
| 2960 || CODING_ISO_DESIGNATION (coding, 3) < 0) | |
| 2961 goto invalid_code; | |
| 2962 CODING_ISO_INVOCATION (coding, 0) = 3; | |
| 2963 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2964 continue; |
| 17052 | 2965 |
| 2966 case 'N': /* invocation of single-shift-2 */ | |
| 88365 | 2967 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT) |
| 2968 || CODING_ISO_DESIGNATION (coding, 2) < 0) | |
| 2969 goto invalid_code; | |
| 2970 charset = CHARSET_FROM_ID (CODING_ISO_DESIGNATION (coding, 2)); | |
| 17052 | 2971 ONE_MORE_BYTE (c1); |
|
30578
705b94e152b1
(decode_coding_iso2022): More strict check for handling single
Kenichi Handa <handa@m17n.org>
parents:
30487
diff
changeset
|
2972 if (c1 < 0x20 || (c1 >= 0x80 && c1 < 0xA0)) |
| 88365 | 2973 goto invalid_code; |
| 17052 | 2974 break; |
| 2975 | |
| 2976 case 'O': /* invocation of single-shift-3 */ | |
| 88365 | 2977 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT) |
| 2978 || CODING_ISO_DESIGNATION (coding, 3) < 0) | |
| 2979 goto invalid_code; | |
| 2980 charset = CHARSET_FROM_ID (CODING_ISO_DESIGNATION (coding, 3)); | |
| 17052 | 2981 ONE_MORE_BYTE (c1); |
|
30578
705b94e152b1
(decode_coding_iso2022): More strict check for handling single
Kenichi Handa <handa@m17n.org>
parents:
30487
diff
changeset
|
2982 if (c1 < 0x20 || (c1 >= 0x80 && c1 < 0xA0)) |
| 88365 | 2983 goto invalid_code; |
| 17052 | 2984 break; |
| 2985 | |
| 26847 | 2986 case '0': case '2': case '3': case '4': /* start composition */ |
| 88365 | 2987 if (! (coding->common_flags & CODING_ANNOTATE_COMPOSITION_MASK)) |
| 2988 goto invalid_code; | |
| 26847 | 2989 DECODE_COMPOSITION_START (c1); |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2990 continue; |
| 17052 | 2991 |
| 26847 | 2992 case '1': /* end composition */ |
| 88365 | 2993 if (composition_state == COMPOSING_NO) |
| 2994 goto invalid_code; | |
| 2995 DECODE_COMPOSITION_END (); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
2996 continue; |
| 17052 | 2997 |
| 2998 case '[': /* specification of direction */ | |
| 88365 | 2999 if (! CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DIRECTION) |
| 3000 goto invalid_code; | |
| 17052 | 3001 /* For the moment, nested direction is not supported. |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3002 So, `coding->mode & CODING_MODE_DIRECTION' zero means |
| 88365 | 3003 left-to-right, and nozero means right-to-left. */ |
| 17052 | 3004 ONE_MORE_BYTE (c1); |
| 3005 switch (c1) | |
| 3006 { | |
| 3007 case ']': /* end of the current direction */ | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3008 coding->mode &= ~CODING_MODE_DIRECTION; |
| 17052 | 3009 |
| 3010 case '0': /* end of the current direction */ | |
| 3011 case '1': /* start of left-to-right direction */ | |
| 3012 ONE_MORE_BYTE (c1); | |
| 3013 if (c1 == ']') | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3014 coding->mode &= ~CODING_MODE_DIRECTION; |
| 17052 | 3015 else |
| 88365 | 3016 goto invalid_code; |
| 17052 | 3017 break; |
| 3018 | |
| 3019 case '2': /* start of right-to-left direction */ | |
| 3020 ONE_MORE_BYTE (c1); | |
| 3021 if (c1 == ']') | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3022 coding->mode |= CODING_MODE_DIRECTION; |
| 17052 | 3023 else |
| 88365 | 3024 goto invalid_code; |
| 17052 | 3025 break; |
| 3026 | |
| 3027 default: | |
| 88365 | 3028 goto invalid_code; |
| 17052 | 3029 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3030 continue; |
| 17052 | 3031 |
| 3032 default: | |
| 88365 | 3033 if (! (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DESIGNATION)) |
| 3034 goto invalid_code; | |
| 17052 | 3035 if (c1 >= 0x28 && c1 <= 0x2B) |
| 3036 { /* designation of DIMENSION1_CHARS94 character set */ | |
| 3037 ONE_MORE_BYTE (c2); | |
| 88365 | 3038 DECODE_DESIGNATION (c1 - 0x28, 1, 0, c2); |
| 17052 | 3039 } |
| 3040 else if (c1 >= 0x2C && c1 <= 0x2F) | |
| 3041 { /* designation of DIMENSION1_CHARS96 character set */ | |
| 3042 ONE_MORE_BYTE (c2); | |
| 88365 | 3043 DECODE_DESIGNATION (c1 - 0x2C, 1, 1, c2); |
| 17052 | 3044 } |
| 3045 else | |
| 88365 | 3046 goto invalid_code; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3047 /* We must update these variables now. */ |
| 88365 | 3048 charset_id_0 = CODING_ISO_INVOKED_CHARSET (coding, 0); |
| 3049 charset_id_1 = CODING_ISO_INVOKED_CHARSET (coding, 1); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3050 continue; |
| 17052 | 3051 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3052 } |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3053 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3054 /* Now we know CHARSET and 1st position code C1 of a character. |
| 88365 | 3055 Produce a decoded character while getting 2nd position code |
| 3056 C2 if necessary. */ | |
| 3057 c1 &= 0x7F; | |
| 3058 if (CHARSET_DIMENSION (charset) > 1) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3059 { |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3060 ONE_MORE_BYTE (c2); |
| 88365 | 3061 if (c2 < 0x20 || (c2 >= 0x80 && c2 < 0xA0)) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3062 /* C2 is not in a valid range. */ |
| 88365 | 3063 goto invalid_code; |
| 3064 c1 = (c1 << 8) | (c2 & 0x7F); | |
| 3065 if (CHARSET_DIMENSION (charset) > 2) | |
| 3066 { | |
| 3067 ONE_MORE_BYTE (c2); | |
| 3068 if (c2 < 0x20 || (c2 >= 0x80 && c2 < 0xA0)) | |
| 3069 /* C2 is not in a valid range. */ | |
| 3070 goto invalid_code; | |
| 3071 c1 = (c1 << 8) | (c2 & 0x7F); | |
| 3072 } | |
| 17052 | 3073 } |
| 88365 | 3074 |
| 3075 CODING_DECODE_CHAR (coding, src, src_base, src_end, charset, c1, c); | |
| 3076 if (c < 0) | |
| 3077 { | |
| 3078 MAYBE_FINISH_COMPOSITION (); | |
| 3079 for (; src_base < src; src_base++, char_offset++) | |
| 3080 { | |
| 3081 if (ASCII_BYTE_P (*src_base)) | |
| 3082 *charbuf++ = *src_base; | |
| 3083 else | |
| 3084 *charbuf++ = BYTE8_TO_CHAR (*src_base); | |
| 3085 } | |
| 3086 } | |
| 3087 else if (composition_state == COMPOSING_NO) | |
| 3088 { | |
| 3089 *charbuf++ = c; | |
| 3090 char_offset++; | |
| 3091 } | |
| 3092 else | |
|
88585
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3093 { |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3094 components[component_idx++] = c; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3095 if (method == COMPOSITION_WITH_RULE |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3096 || (method == COMPOSITION_WITH_RULE_ALTCHARS |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3097 && composition_state == COMPOSING_COMPONENT_CHAR)) |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3098 composition_state++; |
|
c7772f702227
(ONE_MORE_BYTE_NO_CHECK): Increment consumed_chars.
Kenichi Handa <handa@m17n.org>
parents:
88573
diff
changeset
|
3099 } |
| 17052 | 3100 continue; |
| 3101 | |
| 88365 | 3102 invalid_code: |
| 3103 MAYBE_FINISH_COMPOSITION (); | |
| 3104 src = src_base; | |
| 3105 consumed_chars = consumed_chars_base; | |
| 3106 ONE_MORE_BYTE (c); | |
| 3107 *charbuf++ = ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3108 coding->errors++; |
| 88365 | 3109 } |
| 3110 | |
| 3111 no_more_source: | |
| 3112 coding->consumed_char += consumed_chars_base; | |
| 3113 coding->consumed = src_base - coding->source; | |
| 3114 coding->charbuf_used = charbuf - coding->charbuf; | |
| 17052 | 3115 } |
| 3116 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3117 |
| 18766 | 3118 /* ISO2022 encoding stuff. */ |
| 17052 | 3119 |
| 3120 /* | |
| 18766 | 3121 It is not enough to say just "ISO2022" on encoding, we have to |
| 88365 | 3122 specify more details. In Emacs, each coding system of ISO2022 |
| 17052 | 3123 variant has the following specifications: |
| 88365 | 3124 1. Initial designation to G0 thru G3. |
| 17052 | 3125 2. Allows short-form designation? |
| 3126 3. ASCII should be designated to G0 before control characters? | |
| 3127 4. ASCII should be designated to G0 at end of line? | |
| 3128 5. 7-bit environment or 8-bit environment? | |
| 3129 6. Use locking-shift? | |
| 3130 7. Use Single-shift? | |
| 3131 And the following two are only for Japanese: | |
| 3132 8. Use ASCII in place of JIS0201-1976-Roman? | |
| 3133 9. Use JISX0208-1983 in place of JISX0208-1978? | |
| 88365 | 3134 These specifications are encoded in CODING_ISO_FLAGS (coding) as flag bits |
| 3135 defined by macros CODING_ISO_FLAG_XXX. See `coding.h' for more | |
| 18766 | 3136 details. |
| 17052 | 3137 */ |
| 3138 | |
| 3139 /* Produce codes (escape sequence) for designating CHARSET to graphic | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3140 register REG at DST, and increment DST. If <final-char> of CHARSET is |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3141 '@', 'A', or 'B' and the coding system CODING allows, produce |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3142 designation sequence of short-form. */ |
| 17052 | 3143 |
| 3144 #define ENCODE_DESIGNATION(charset, reg, coding) \ | |
| 3145 do { \ | |
| 88365 | 3146 unsigned char final_char = CHARSET_ISO_FINAL (charset); \ |
| 17052 | 3147 char *intermediate_char_94 = "()*+"; \ |
| 3148 char *intermediate_char_96 = ",-./"; \ | |
| 88365 | 3149 int revision = -1; \ |
| 3150 int c; \ | |
| 3151 \ | |
| 3152 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_REVISION) \ | |
| 88856 | 3153 revision = CHARSET_ISO_REVISION (charset); \ |
| 88365 | 3154 \ |
| 3155 if (revision >= 0) \ | |
|
20150
402b6e5f4b58
(encode_designation_at_bol): Fix bug of finding graphic
Kenichi Handa <handa@m17n.org>
parents:
20105
diff
changeset
|
3156 { \ |
| 88365 | 3157 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, '&'); \ |
| 3158 EMIT_ONE_BYTE ('@' + revision); \ | |
| 17052 | 3159 } \ |
| 88365 | 3160 EMIT_ONE_ASCII_BYTE (ISO_CODE_ESC); \ |
| 17052 | 3161 if (CHARSET_DIMENSION (charset) == 1) \ |
| 3162 { \ | |
| 88365 | 3163 if (! CHARSET_ISO_CHARS_96 (charset)) \ |
| 3164 c = intermediate_char_94[reg]; \ | |
| 17052 | 3165 else \ |
| 88365 | 3166 c = intermediate_char_96[reg]; \ |
| 3167 EMIT_ONE_ASCII_BYTE (c); \ | |
| 17052 | 3168 } \ |
| 3169 else \ | |
| 3170 { \ | |
| 88365 | 3171 EMIT_ONE_ASCII_BYTE ('$'); \ |
| 3172 if (! CHARSET_ISO_CHARS_96 (charset)) \ | |
| 17052 | 3173 { \ |
| 88365 | 3174 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_LONG_FORM \ |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3175 || reg != 0 \ |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3176 || final_char < '@' || final_char > 'B') \ |
| 88365 | 3177 EMIT_ONE_ASCII_BYTE (intermediate_char_94[reg]); \ |
| 17052 | 3178 } \ |
| 3179 else \ | |
| 88365 | 3180 EMIT_ONE_ASCII_BYTE (intermediate_char_96[reg]); \ |
| 17052 | 3181 } \ |
| 88365 | 3182 EMIT_ONE_ASCII_BYTE (final_char); \ |
| 3183 \ | |
| 3184 CODING_ISO_DESIGNATION (coding, reg) = CHARSET_ID (charset); \ | |
| 17052 | 3185 } while (0) |
| 3186 | |
| 88365 | 3187 |
| 17052 | 3188 /* The following two macros produce codes (control character or escape |
| 3189 sequence) for ISO2022 single-shift functions (single-shift-2 and | |
| 3190 single-shift-3). */ | |
| 3191 | |
| 88365 | 3192 #define ENCODE_SINGLE_SHIFT_2 \ |
| 3193 do { \ | |
| 3194 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) \ | |
| 3195 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, 'N'); \ | |
| 3196 else \ | |
| 3197 EMIT_ONE_BYTE (ISO_CODE_SS2); \ | |
| 3198 CODING_ISO_SINGLE_SHIFTING (coding) = 1; \ | |
| 17052 | 3199 } while (0) |
| 3200 | |
| 88365 | 3201 |
| 3202 #define ENCODE_SINGLE_SHIFT_3 \ | |
| 3203 do { \ | |
| 3204 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) \ | |
| 3205 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, 'O'); \ | |
| 3206 else \ | |
| 3207 EMIT_ONE_BYTE (ISO_CODE_SS3); \ | |
| 3208 CODING_ISO_SINGLE_SHIFTING (coding) = 1; \ | |
| 17052 | 3209 } while (0) |
| 3210 | |
| 88365 | 3211 |
| 17052 | 3212 /* The following four macros produce codes (control character or |
| 3213 escape sequence) for ISO2022 locking-shift functions (shift-in, | |
| 3214 shift-out, locking-shift-2, and locking-shift-3). */ | |
| 3215 | |
| 88365 | 3216 #define ENCODE_SHIFT_IN \ |
| 3217 do { \ | |
| 3218 EMIT_ONE_ASCII_BYTE (ISO_CODE_SI); \ | |
| 3219 CODING_ISO_INVOCATION (coding, 0) = 0; \ | |
| 17052 | 3220 } while (0) |
| 3221 | |
| 88365 | 3222 |
| 3223 #define ENCODE_SHIFT_OUT \ | |
| 3224 do { \ | |
| 3225 EMIT_ONE_ASCII_BYTE (ISO_CODE_SO); \ | |
| 3226 CODING_ISO_INVOCATION (coding, 0) = 1; \ | |
| 17052 | 3227 } while (0) |
| 3228 | |
| 88365 | 3229 |
| 3230 #define ENCODE_LOCKING_SHIFT_2 \ | |
| 3231 do { \ | |
| 3232 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, 'n'); \ | |
| 3233 CODING_ISO_INVOCATION (coding, 0) = 2; \ | |
| 17052 | 3234 } while (0) |
| 3235 | |
| 88365 | 3236 |
| 3237 #define ENCODE_LOCKING_SHIFT_3 \ | |
| 3238 do { \ | |
| 3239 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, 'n'); \ | |
| 3240 CODING_ISO_INVOCATION (coding, 0) = 3; \ | |
| 17052 | 3241 } while (0) |
| 3242 | |
| 88365 | 3243 |
| 18766 | 3244 /* Produce codes for a DIMENSION1 character whose character set is |
| 3245 CHARSET and whose position-code is C1. Designation and invocation | |
| 17052 | 3246 sequences are also produced in advance if necessary. */ |
| 3247 | |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3248 #define ENCODE_ISO_CHARACTER_DIMENSION1(charset, c1) \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3249 do { \ |
| 88365 | 3250 int id = CHARSET_ID (charset); \ |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3251 \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3252 if ((CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_USE_ROMAN) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3253 && id == charset_ascii) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3254 { \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3255 id = charset_jisx0201_roman; \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3256 charset = CHARSET_FROM_ID (id); \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3257 } \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3258 \ |
| 88365 | 3259 if (CODING_ISO_SINGLE_SHIFTING (coding)) \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3260 { \ |
| 88365 | 3261 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) \ |
| 3262 EMIT_ONE_ASCII_BYTE (c1 & 0x7F); \ | |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3263 else \ |
| 88365 | 3264 EMIT_ONE_BYTE (c1 | 0x80); \ |
| 3265 CODING_ISO_SINGLE_SHIFTING (coding) = 0; \ | |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3266 break; \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3267 } \ |
| 88365 | 3268 else if (id == CODING_ISO_INVOKED_CHARSET (coding, 0)) \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3269 { \ |
| 88365 | 3270 EMIT_ONE_ASCII_BYTE (c1 & 0x7F); \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3271 break; \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3272 } \ |
| 88365 | 3273 else if (id == CODING_ISO_INVOKED_CHARSET (coding, 1)) \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3274 { \ |
| 88365 | 3275 EMIT_ONE_BYTE (c1 | 0x80); \ |
|
19285
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3276 break; \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3277 } \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3278 else \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3279 /* Since CHARSET is not yet invoked to any graphic planes, we \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3280 must invoke it, or, at first, designate it to some graphic \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3281 register. Then repeat the loop to actually produce the \ |
|
af3d00fde172
(Fset_terminal_coding_system_internal): Set
Kenichi Handa <handa@m17n.org>
parents:
19280
diff
changeset
|
3282 character. */ \ |
| 88365 | 3283 dst = encode_invocation_designation (charset, coding, dst, \ |
| 3284 &produced_chars); \ | |
| 17052 | 3285 } while (1) |
| 3286 | |
| 88365 | 3287 |
| 3288 /* Produce codes for a DIMENSION2 character whose character set is | |
| 3289 CHARSET and whose position-codes are C1 and C2. Designation and | |
| 3290 invocation codes are also produced in advance if necessary. */ | |
| 3291 | |
| 3292 #define ENCODE_ISO_CHARACTER_DIMENSION2(charset, c1, c2) \ | |
|
24506
219c99669e4b
(ENCODE_ISO_CHARACTER): Check validity of CHARSET. If
Kenichi Handa <handa@m17n.org>
parents:
24460
diff
changeset
|
3293 do { \ |
| 88365 | 3294 int id = CHARSET_ID (charset); \ |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3295 \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3296 if ((CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_USE_OLDJIS) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3297 && id == charset_jisx0208) \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3298 { \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3299 id = charset_jisx0208_1978; \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3300 charset = CHARSET_FROM_ID (id); \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3301 } \ |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3302 \ |
| 88365 | 3303 if (CODING_ISO_SINGLE_SHIFTING (coding)) \ |
| 3304 { \ | |
| 3305 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SEVEN_BITS) \ | |
| 3306 EMIT_TWO_ASCII_BYTES ((c1) & 0x7F, (c2) & 0x7F); \ | |
| 3307 else \ | |
| 3308 EMIT_TWO_BYTES ((c1) | 0x80, (c2) | 0x80); \ | |
| 3309 CODING_ISO_SINGLE_SHIFTING (coding) = 0; \ | |
| 3310 break; \ | |
| 3311 } \ | |
| 3312 else if (id == CODING_ISO_INVOKED_CHARSET (coding, 0)) \ | |
| 3313 { \ | |
| 3314 EMIT_TWO_ASCII_BYTES ((c1) & 0x7F, (c2) & 0x7F); \ | |
| 3315 break; \ | |
| 3316 } \ | |
| 3317 else if (id == CODING_ISO_INVOKED_CHARSET (coding, 1)) \ | |
| 3318 { \ | |
| 3319 EMIT_TWO_BYTES ((c1) | 0x80, (c2) | 0x80); \ | |
| 3320 break; \ | |
| 3321 } \ | |
| 3322 else \ | |
| 3323 /* Since CHARSET is not yet invoked to any graphic planes, we \ | |
| 3324 must invoke it, or, at first, designate it to some graphic \ | |
| 3325 register. Then repeat the loop to actually produce the \ | |
| 3326 character. */ \ | |
| 3327 dst = encode_invocation_designation (charset, coding, dst, \ | |
| 3328 &produced_chars); \ | |
| 3329 } while (1) | |
| 3330 | |
| 3331 | |
| 3332 #define ENCODE_ISO_CHARACTER(charset, c) \ | |
| 3333 do { \ | |
| 3334 int code = ENCODE_CHAR ((charset),(c)); \ | |
| 3335 \ | |
| 3336 if (CHARSET_DIMENSION (charset) == 1) \ | |
| 3337 ENCODE_ISO_CHARACTER_DIMENSION1 ((charset), code); \ | |
| 3338 else \ | |
| 3339 ENCODE_ISO_CHARACTER_DIMENSION2 ((charset), code >> 8, code & 0xFF); \ | |
|
22119
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
3340 } while (0) |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3341 |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
3342 |
| 17052 | 3343 /* Produce designation and invocation codes at a place pointed by DST |
| 88365 | 3344 to use CHARSET. The element `spec.iso_2022' of *CODING is updated. |
| 17052 | 3345 Return new DST. */ |
| 3346 | |
| 3347 unsigned char * | |
| 88365 | 3348 encode_invocation_designation (charset, coding, dst, p_nchars) |
| 3349 struct charset *charset; | |
| 17052 | 3350 struct coding_system *coding; |
| 3351 unsigned char *dst; | |
| 88365 | 3352 int *p_nchars; |
| 17052 | 3353 { |
| 88365 | 3354 int multibytep = coding->dst_multibyte; |
| 3355 int produced_chars = *p_nchars; | |
| 17052 | 3356 int reg; /* graphic register number */ |
| 88365 | 3357 int id = CHARSET_ID (charset); |
| 17052 | 3358 |
| 3359 /* At first, check designations. */ | |
| 3360 for (reg = 0; reg < 4; reg++) | |
| 88365 | 3361 if (id == CODING_ISO_DESIGNATION (coding, reg)) |
| 17052 | 3362 break; |
| 3363 | |
| 3364 if (reg >= 4) | |
| 3365 { | |
| 3366 /* CHARSET is not yet designated to any graphic registers. */ | |
| 3367 /* At first check the requested designation. */ | |
| 88365 | 3368 reg = CODING_ISO_REQUEST (coding, id); |
| 3369 if (reg < 0) | |
|
18002
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
3370 /* Since CHARSET requests no special designation, designate it |
|
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
3371 to graphic register 0. */ |
| 17052 | 3372 reg = 0; |
| 3373 | |
| 3374 ENCODE_DESIGNATION (charset, reg, coding); | |
| 3375 } | |
| 3376 | |
| 88365 | 3377 if (CODING_ISO_INVOCATION (coding, 0) != reg |
| 3378 && CODING_ISO_INVOCATION (coding, 1) != reg) | |
| 17052 | 3379 { |
| 3380 /* Since the graphic register REG is not invoked to any graphic | |
| 3381 planes, invoke it to graphic plane 0. */ | |
| 3382 switch (reg) | |
| 3383 { | |
| 3384 case 0: /* graphic register 0 */ | |
| 3385 ENCODE_SHIFT_IN; | |
| 3386 break; | |
| 3387 | |
| 3388 case 1: /* graphic register 1 */ | |
| 3389 ENCODE_SHIFT_OUT; | |
| 3390 break; | |
| 3391 | |
| 3392 case 2: /* graphic register 2 */ | |
| 88365 | 3393 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT) |
| 17052 | 3394 ENCODE_SINGLE_SHIFT_2; |
| 3395 else | |
| 3396 ENCODE_LOCKING_SHIFT_2; | |
| 3397 break; | |
| 3398 | |
| 3399 case 3: /* graphic register 3 */ | |
| 88365 | 3400 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_SINGLE_SHIFT) |
| 17052 | 3401 ENCODE_SINGLE_SHIFT_3; |
| 3402 else | |
| 3403 ENCODE_LOCKING_SHIFT_3; | |
| 3404 break; | |
| 3405 } | |
| 3406 } | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3407 |
| 88365 | 3408 *p_nchars = produced_chars; |
| 17052 | 3409 return dst; |
| 3410 } | |
| 3411 | |
| 3412 /* The following three macros produce codes for indicating direction | |
| 3413 of text. */ | |
| 88365 | 3414 #define ENCODE_CONTROL_SEQUENCE_INTRODUCER \ |
| 3415 do { \ | |
| 3416 if (CODING_ISO_FLAGS (coding) == CODING_ISO_FLAG_SEVEN_BITS) \ | |
| 3417 EMIT_TWO_ASCII_BYTES (ISO_CODE_ESC, '['); \ | |
| 3418 else \ | |
| 3419 EMIT_ONE_BYTE (ISO_CODE_CSI); \ | |
| 17052 | 3420 } while (0) |
| 3421 | |
| 88365 | 3422 |
| 3423 #define ENCODE_DIRECTION_R2L() \ | |
| 3424 do { \ | |
| 3425 ENCODE_CONTROL_SEQUENCE_INTRODUCER (dst); \ | |
| 3426 EMIT_TWO_ASCII_BYTES ('2', ']'); \ | |
| 3427 } while (0) | |
| 3428 | |
| 3429 | |
| 3430 #define ENCODE_DIRECTION_L2R() \ | |
| 3431 do { \ | |
| 3432 ENCODE_CONTROL_SEQUENCE_INTRODUCER (dst); \ | |
| 3433 EMIT_TWO_ASCII_BYTES ('0', ']'); \ | |
| 3434 } while (0) | |
| 3435 | |
| 17052 | 3436 |
| 3437 /* Produce codes for designation and invocation to reset the graphic | |
| 3438 planes and registers to initial state. */ | |
| 88365 | 3439 #define ENCODE_RESET_PLANE_AND_REGISTER() \ |
| 3440 do { \ | |
| 3441 int reg; \ | |
| 3442 struct charset *charset; \ | |
| 3443 \ | |
| 3444 if (CODING_ISO_INVOCATION (coding, 0) != 0) \ | |
| 3445 ENCODE_SHIFT_IN; \ | |
| 3446 for (reg = 0; reg < 4; reg++) \ | |
| 3447 if (CODING_ISO_INITIAL (coding, reg) >= 0 \ | |
| 3448 && (CODING_ISO_DESIGNATION (coding, reg) \ | |
| 3449 != CODING_ISO_INITIAL (coding, reg))) \ | |
| 3450 { \ | |
| 3451 charset = CHARSET_FROM_ID (CODING_ISO_INITIAL (coding, reg)); \ | |
| 3452 ENCODE_DESIGNATION (charset, reg, coding); \ | |
| 3453 } \ | |
| 17052 | 3454 } while (0) |
| 3455 | |
| 88365 | 3456 |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3457 /* Produce designation sequences of charsets in the line started from |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3458 SRC to a place pointed by DST, and return updated DST. |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3459 |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3460 If the current block ends before any end-of-line, we may fail to |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3461 find all the necessary designations. */ |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
3462 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3463 static unsigned char * |
| 88365 | 3464 encode_designation_at_bol (coding, charbuf, charbuf_end, dst) |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3465 struct coding_system *coding; |
| 88365 | 3466 int *charbuf, *charbuf_end; |
| 3467 unsigned char *dst; | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3468 { |
| 88365 | 3469 struct charset *charset; |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3470 /* Table of charsets to be designated to each graphic register. */ |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3471 int r[4]; |
| 88365 | 3472 int c, found = 0, reg; |
| 3473 int produced_chars = 0; | |
| 3474 int multibytep = coding->dst_multibyte; | |
| 3475 Lisp_Object attrs; | |
| 3476 Lisp_Object charset_list; | |
| 3477 | |
| 3478 attrs = CODING_ID_ATTRS (coding->id); | |
| 3479 charset_list = CODING_ATTR_CHARSET_LIST (attrs); | |
| 3480 if (EQ (charset_list, Qiso_2022)) | |
| 3481 charset_list = Viso_2022_charset_list; | |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3482 |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3483 for (reg = 0; reg < 4; reg++) |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3484 r[reg] = -1; |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3485 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3486 while (found < 4) |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3487 { |
| 88365 | 3488 int id; |
| 3489 | |
| 3490 c = *charbuf++; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3491 if (c == '\n') |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3492 break; |
| 88365 | 3493 charset = char_charset (c, charset_list, NULL); |
| 3494 id = CHARSET_ID (charset); | |
| 3495 reg = CODING_ISO_REQUEST (coding, id); | |
| 3496 if (reg >= 0 && r[reg] < 0) | |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3497 { |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3498 found++; |
| 88365 | 3499 r[reg] = id; |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3500 } |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3501 } |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3502 |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3503 if (found) |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3504 { |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3505 for (reg = 0; reg < 4; reg++) |
|
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3506 if (r[reg] >= 0 |
| 88365 | 3507 && CODING_ISO_DESIGNATION (coding, reg) != r[reg]) |
| 3508 ENCODE_DESIGNATION (CHARSET_FROM_ID (r[reg]), reg, coding); | |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3509 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3510 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3511 return dst; |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3512 } |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3513 |
| 17052 | 3514 /* See the above "GENERAL NOTES on `encode_coding_XXX ()' functions". */ |
| 3515 | |
| 88365 | 3516 static int |
| 3517 encode_coding_iso_2022 (coding) | |
| 17052 | 3518 struct coding_system *coding; |
| 3519 { | |
| 88365 | 3520 int multibytep = coding->dst_multibyte; |
| 3521 int *charbuf = coding->charbuf; | |
| 3522 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 3523 unsigned char *dst = coding->destination + coding->produced; | |
| 3524 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 3525 int safe_room = 16; | |
| 3526 int bol_designation | |
| 3527 = (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DESIGNATE_AT_BOL | |
| 3528 && CODING_ISO_BOL (coding)); | |
| 3529 int produced_chars = 0; | |
| 3530 Lisp_Object attrs, eol_type, charset_list; | |
| 3531 int ascii_compatible; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3532 int c; |
| 88365 | 3533 |
| 3534 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
|
88497
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
3535 setup_iso_safe_charsets (attrs); |
|
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
3536 coding->safe_charsets |
|
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
3537 = (char *) XSTRING (CODING_ATTR_SAFE_CHARSETS(attrs))->data; |
| 88365 | 3538 |
| 3539 ascii_compatible = ! NILP (CODING_ATTR_ASCII_COMPAT (attrs)); | |
| 3540 | |
| 3541 while (charbuf < charbuf_end) | |
| 3542 { | |
| 3543 ASSURE_DESTINATION (safe_room); | |
| 3544 | |
| 3545 if (bol_designation) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3546 { |
| 88365 | 3547 unsigned char *dst_prev = dst; |
| 3548 | |
|
17725
92f042f73be2
(Valternate_charset_table): The valiable deleted.
Kenichi Handa <handa@m17n.org>
parents:
17717
diff
changeset
|
3549 /* We have to produce designation sequences if any now. */ |
| 88365 | 3550 dst = encode_designation_at_bol (coding, charbuf, charbuf_end, dst); |
| 3551 bol_designation = 0; | |
| 3552 /* We are sure that designation sequences are all ASCII bytes. */ | |
| 3553 produced_chars += dst - dst_prev; | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3554 } |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
3555 |
| 88365 | 3556 c = *charbuf++; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3557 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3558 /* Now encode the character C. */ |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3559 if (c < 0x20 || c == 0x7F) |
| 17052 | 3560 { |
| 88365 | 3561 if (c == '\n' |
| 3562 || (c == '\r' && EQ (eol_type, Qmac))) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3563 { |
| 88365 | 3564 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_RESET_AT_EOL) |
| 3565 ENCODE_RESET_PLANE_AND_REGISTER (); | |
| 3566 if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_INIT_AT_BOL) | |
| 3567 { | |
| 3568 int i; | |
| 3569 | |
| 3570 for (i = 0; i < 4; i++) | |
| 3571 CODING_ISO_DESIGNATION (coding, i) | |
| 3572 = CODING_ISO_INITIAL (coding, i); | |
| 3573 } | |
| 3574 bol_designation | |
| 3575 = CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_DESIGNATE_AT_BOL; | |
|
19052
302a7b2a6948
(encode_coding_iso2022): Write out invalid multibyte
Kenichi Handa <handa@m17n.org>
parents:
18910
diff
changeset
|
3576 } |
| 88365 | 3577 else if (CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_RESET_AT_CNTL) |
| 3578 ENCODE_RESET_PLANE_AND_REGISTER (); | |
| 3579 EMIT_ONE_ASCII_BYTE (c); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3580 } |
| 88365 | 3581 else if (ASCII_CHAR_P (c)) |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3582 { |
| 88365 | 3583 if (ascii_compatible) |
| 3584 EMIT_ONE_ASCII_BYTE (c); | |
| 3585 else | |
|
88681
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3586 { |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3587 struct charset *charset = CHARSET_FROM_ID (charset_ascii); |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3588 ENCODE_ISO_CHARACTER (charset, c); |
|
2cdfbffa8a0d
(CODING_ISO_FLAG_USE_ROMAN): New macro
Kenichi Handa <handa@m17n.org>
parents:
88669
diff
changeset
|
3589 } |
| 17052 | 3590 } |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3591 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3592 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3593 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3594 EMIT_ONE_BYTE (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3595 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3596 else |
| 88365 | 3597 { |
| 3598 struct charset *charset = char_charset (c, charset_list, NULL); | |
| 3599 | |
| 3600 if (!charset) | |
| 3601 { | |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3602 if (coding->mode & CODING_MODE_SAFE_ENCODING) |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3603 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3604 c = CODING_INHIBIT_CHARACTER_SUBSTITUTION; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3605 charset = CHARSET_FROM_ID (charset_ascii); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3606 } |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3607 else |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3608 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3609 c = coding->default_char; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3610 charset = char_charset (c, charset_list, NULL); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3611 } |
| 88365 | 3612 } |
| 3613 ENCODE_ISO_CHARACTER (charset, c); | |
| 3614 } | |
| 3615 } | |
| 3616 | |
| 3617 if (coding->mode & CODING_MODE_LAST_BLOCK | |
| 3618 && CODING_ISO_FLAGS (coding) & CODING_ISO_FLAG_RESET_AT_EOL) | |
| 3619 { | |
| 3620 ASSURE_DESTINATION (safe_room); | |
| 3621 ENCODE_RESET_PLANE_AND_REGISTER (); | |
| 3622 } | |
| 3623 coding->result = CODING_RESULT_SUCCESS; | |
| 3624 CODING_ISO_BOL (coding) = bol_designation; | |
| 3625 coding->produced_char += produced_chars; | |
| 3626 coding->produced = dst - coding->destination; | |
| 3627 return 0; | |
| 17052 | 3628 } |
| 3629 | |
| 3630 | |
| 88365 | 3631 /*** 8,9. SJIS and BIG5 handlers ***/ |
| 3632 | |
| 3633 /* Although SJIS and BIG5 are not ISO's coding system, they are used | |
| 17052 | 3634 quite widely. So, for the moment, Emacs supports them in the bare |
| 3635 C code. But, in the future, they may be supported only by CCL. */ | |
| 3636 | |
| 3637 /* SJIS is a coding system encoding three character sets: ASCII, right | |
| 3638 half of JISX0201-Kana, and JISX0208. An ASCII character is encoded | |
| 3639 as is. A character of charset katakana-jisx0201 is encoded by | |
| 3640 "position-code + 0x80". A character of charset japanese-jisx0208 | |
| 3641 is encoded in 2-byte but two position-codes are divided and shifted | |
| 88365 | 3642 so that it fit in the range below. |
| 17052 | 3643 |
| 3644 --- CODE RANGE of SJIS --- | |
| 3645 (character set) (range) | |
| 3646 ASCII 0x00 .. 0x7F | |
| 88365 | 3647 KATAKANA-JISX0201 0xA0 .. 0xDF |
|
24324
2eec590faf26
(Fdecode_sjis_char, Fencode_sjis_char): Hanlde
Kenichi Handa <handa@m17n.org>
parents:
24316
diff
changeset
|
3648 JISX0208 (1st byte) 0x81 .. 0x9F and 0xE0 .. 0xEF |
|
23564
6eb3e346d1fd
(DECODE_CHARACTER_ASCII): Check validity of inserted
Kenichi Handa <handa@m17n.org>
parents:
23542
diff
changeset
|
3649 (2nd byte) 0x40 .. 0x7E and 0x80 .. 0xFC |
| 17052 | 3650 ------------------------------- |
| 3651 | |
| 3652 */ | |
| 3653 | |
| 3654 /* BIG5 is a coding system encoding two character sets: ASCII and | |
| 3655 Big5. An ASCII character is encoded as is. Big5 is a two-byte | |
| 88365 | 3656 character set and is encoded in two-byte. |
| 17052 | 3657 |
| 3658 --- CODE RANGE of BIG5 --- | |
| 3659 (character set) (range) | |
| 3660 ASCII 0x00 .. 0x7F | |
| 3661 Big5 (1st byte) 0xA1 .. 0xFE | |
| 3662 (2nd byte) 0x40 .. 0x7E and 0xA1 .. 0xFE | |
| 3663 -------------------------- | |
| 3664 | |
| 88365 | 3665 */ |
| 17052 | 3666 |
| 3667 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
| 3668 Check if a text is encoded in SJIS. If it is, return | |
| 88365 | 3669 CATEGORY_MASK_SJIS, else return 0. */ |
| 17052 | 3670 |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
3671 static int |
| 88365 | 3672 detect_coding_sjis (coding, mask) |
| 3673 struct coding_system *coding; | |
| 3674 int *mask; | |
| 17052 | 3675 { |
| 88365 | 3676 unsigned char *src = coding->source, *src_base = src; |
| 3677 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 3678 int multibytep = coding->src_multibyte; | |
| 3679 int consumed_chars = 0; | |
| 3680 int found = 0; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3681 int c; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3682 int incomplete; |
| 88365 | 3683 |
| 3684 /* A coding system of this category is always ASCII compatible. */ | |
| 3685 src += coding->head_ascii; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3686 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3687 while (1) |
| 17052 | 3688 { |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3689 incomplete = 0; |
| 88365 | 3690 ONE_MORE_BYTE (c); |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3691 incomplete = 1; |
|
36647
0a75ccbe42b2
(detect_coding_sjis): Do more rigid check.
Kenichi Handa <handa@m17n.org>
parents:
36520
diff
changeset
|
3692 if (c < 0x80) |
|
0a75ccbe42b2
(detect_coding_sjis): Do more rigid check.
Kenichi Handa <handa@m17n.org>
parents:
36520
diff
changeset
|
3693 continue; |
| 88365 | 3694 if ((c >= 0x81 && c <= 0x9F) || (c >= 0xE0 && c <= 0xEF)) |
| 17052 | 3695 { |
| 88365 | 3696 ONE_MORE_BYTE (c); |
|
36647
0a75ccbe42b2
(detect_coding_sjis): Do more rigid check.
Kenichi Handa <handa@m17n.org>
parents:
36520
diff
changeset
|
3697 if (c < 0x40 || c == 0x7F || c > 0xFC) |
| 88365 | 3698 break; |
| 3699 found = 1; | |
| 17052 | 3700 } |
| 88365 | 3701 else if (c >= 0xA0 && c < 0xE0) |
| 3702 found = 1; | |
| 3703 else | |
| 3704 break; | |
| 3705 } | |
| 3706 *mask &= ~CATEGORY_MASK_SJIS; | |
| 3707 return 0; | |
| 3708 | |
| 3709 no_more_source: | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3710 if (incomplete && coding->mode & CODING_MODE_LAST_BLOCK) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3711 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3712 *mask &= ~CATEGORY_MASK_SJIS; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3713 return 0; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3714 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3715 return found; |
| 17052 | 3716 } |
| 3717 | |
| 3718 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". | |
| 3719 Check if a text is encoded in BIG5. If it is, return | |
| 88365 | 3720 CATEGORY_MASK_BIG5, else return 0. */ |
| 17052 | 3721 |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
3722 static int |
| 88365 | 3723 detect_coding_big5 (coding, mask) |
| 3724 struct coding_system *coding; | |
| 3725 int *mask; | |
| 17052 | 3726 { |
| 88365 | 3727 unsigned char *src = coding->source, *src_base = src; |
| 3728 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 3729 int multibytep = coding->src_multibyte; | |
| 3730 int consumed_chars = 0; | |
| 3731 int found = 0; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3732 int c; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3733 int incomplete; |
| 88365 | 3734 |
| 3735 /* A coding system of this category is always ASCII compatible. */ | |
| 3736 src += coding->head_ascii; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3737 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3738 while (1) |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
3739 { |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3740 incomplete = 0; |
| 88365 | 3741 ONE_MORE_BYTE (c); |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3742 incomplete = 1; |
| 88365 | 3743 if (c < 0x80) |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
3744 continue; |
| 88365 | 3745 if (c >= 0xA1) |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
3746 { |
| 88365 | 3747 ONE_MORE_BYTE (c); |
| 3748 if (c < 0x40 || (c >= 0x7F && c <= 0xA0)) | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
3749 return 0; |
| 88365 | 3750 found = 1; |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
3751 } |
| 88365 | 3752 else |
| 3753 break; | |
| 3754 } | |
| 3755 *mask &= ~CATEGORY_MASK_BIG5; | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
3756 return 0; |
| 88365 | 3757 |
| 3758 no_more_source: | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3759 if (incomplete && coding->mode & CODING_MODE_LAST_BLOCK) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3760 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3761 *mask &= ~CATEGORY_MASK_BIG5; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3762 return 0; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3763 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3764 return found; |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
3765 } |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
3766 |
| 17052 | 3767 /* See the above "GENERAL NOTES on `decode_coding_XXX ()' functions". |
| 3768 If SJIS_P is 1, decode SJIS text, else decode BIG5 test. */ | |
| 3769 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3770 static void |
| 88365 | 3771 decode_coding_sjis (coding) |
| 17052 | 3772 struct coding_system *coding; |
| 3773 { | |
| 88365 | 3774 unsigned char *src = coding->source + coding->consumed; |
| 3775 unsigned char *src_end = coding->source + coding->src_bytes; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3776 unsigned char *src_base; |
| 88365 | 3777 int *charbuf = coding->charbuf; |
| 3778 int *charbuf_end = charbuf + coding->charbuf_size; | |
| 3779 int consumed_chars = 0, consumed_chars_base; | |
| 3780 int multibytep = coding->src_multibyte; | |
| 3781 struct charset *charset_roman, *charset_kanji, *charset_kana; | |
| 3782 Lisp_Object attrs, eol_type, charset_list, val; | |
| 3783 | |
| 3784 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
| 3785 | |
| 3786 val = charset_list; | |
| 3787 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3788 charset_kana = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3789 charset_kanji = CHARSET_FROM_ID (XINT (XCAR (val))); |
| 88365 | 3790 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3791 while (1) |
| 17052 | 3792 { |
| 88365 | 3793 int c, c1; |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3794 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3795 src_base = src; |
| 88365 | 3796 consumed_chars_base = consumed_chars; |
| 3797 | |
| 3798 if (charbuf >= charbuf_end) | |
| 3799 break; | |
| 3800 | |
| 3801 ONE_MORE_BYTE (c); | |
| 3802 | |
| 3803 if (c == '\r') | |
| 17052 | 3804 { |
| 88365 | 3805 if (EQ (eol_type, Qdos)) |
| 17052 | 3806 { |
| 88365 | 3807 if (src == src_end) |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
3808 { |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
3809 coding->result = CODING_RESULT_INSUFFICIENT_SRC; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
3810 goto no_more_source; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
3811 } |
| 88365 | 3812 if (*src == '\n') |
| 3813 ONE_MORE_BYTE (c); | |
| 17052 | 3814 } |
| 88365 | 3815 else if (EQ (eol_type, Qmac)) |
| 3816 c = '\n'; | |
| 17052 | 3817 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3818 else |
| 88365 | 3819 { |
| 3820 struct charset *charset; | |
| 3821 | |
| 3822 if (c < 0x80) | |
| 3823 charset = charset_roman; | |
| 3824 else | |
| 17052 | 3825 { |
| 88365 | 3826 if (c >= 0xF0) |
| 3827 goto invalid_code; | |
| 3828 if (c < 0xA0 || c >= 0xE0) | |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
3829 { |
|
22616
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
3830 /* SJIS -> JISX0208 */ |
| 88365 | 3831 ONE_MORE_BYTE (c1); |
| 3832 if (c1 < 0x40 || c1 == 0x7F || c1 > 0xFC) | |
| 3833 goto invalid_code; | |
| 3834 c = (c << 8) | c1; | |
| 3835 SJIS_TO_JIS (c); | |
| 3836 charset = charset_kanji; | |
|
24870
b0f6eab5deeb
(decode_coding_sjis_big5): Avoid compiler warning.
Kenichi Handa <handa@m17n.org>
parents:
24822
diff
changeset
|
3837 } |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
3838 else |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3839 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3840 /* SJIS -> JISX0201-Kana */ |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3841 c &= 0x7F; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3842 charset = charset_kana; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
3843 } |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
3844 } |
| 88365 | 3845 CODING_DECODE_CHAR (coding, src, src_base, src_end, charset, c, c); |
| 3846 } | |
| 3847 *charbuf++ = c; | |
| 3848 continue; | |
| 3849 | |
| 3850 invalid_code: | |
| 3851 src = src_base; | |
| 3852 consumed_chars = consumed_chars_base; | |
| 3853 ONE_MORE_BYTE (c); | |
| 3854 *charbuf++ = ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); | |
| 3855 coding->errors++; | |
| 3856 } | |
| 3857 | |
| 3858 no_more_source: | |
| 3859 coding->consumed_char += consumed_chars_base; | |
| 3860 coding->consumed = src_base - coding->source; | |
| 3861 coding->charbuf_used = charbuf - coding->charbuf; | |
| 3862 } | |
| 3863 | |
| 3864 static void | |
| 3865 decode_coding_big5 (coding) | |
| 3866 struct coding_system *coding; | |
| 3867 { | |
| 3868 unsigned char *src = coding->source + coding->consumed; | |
| 3869 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 3870 unsigned char *src_base; | |
| 3871 int *charbuf = coding->charbuf; | |
| 3872 int *charbuf_end = charbuf + coding->charbuf_size; | |
| 3873 int consumed_chars = 0, consumed_chars_base; | |
| 3874 int multibytep = coding->src_multibyte; | |
| 3875 struct charset *charset_roman, *charset_big5; | |
| 3876 Lisp_Object attrs, eol_type, charset_list, val; | |
| 3877 | |
| 3878 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
| 3879 val = charset_list; | |
| 3880 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
| 3881 charset_big5 = CHARSET_FROM_ID (XINT (XCAR (val))); | |
| 3882 | |
| 3883 while (1) | |
| 3884 { | |
| 3885 int c, c1; | |
| 3886 | |
| 3887 src_base = src; | |
| 3888 consumed_chars_base = consumed_chars; | |
| 3889 | |
| 3890 if (charbuf >= charbuf_end) | |
| 3891 break; | |
| 3892 | |
| 3893 ONE_MORE_BYTE (c); | |
| 3894 | |
| 3895 if (c == '\r') | |
| 3896 { | |
| 3897 if (EQ (eol_type, Qdos)) | |
| 3898 { | |
| 3899 if (src == src_end) | |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
3900 { |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
3901 coding->result = CODING_RESULT_INSUFFICIENT_SRC; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
3902 goto no_more_source; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
3903 } |
| 88365 | 3904 if (*src == '\n') |
| 3905 ONE_MORE_BYTE (c); | |
| 3906 } | |
| 3907 else if (EQ (eol_type, Qmac)) | |
| 3908 c = '\n'; | |
| 3909 } | |
| 3910 else | |
| 3911 { | |
| 3912 struct charset *charset; | |
| 3913 if (c < 0x80) | |
| 3914 charset = charset_roman; | |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
3915 else |
|
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
3916 { |
|
22616
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
3917 /* BIG5 -> Big5 */ |
| 88365 | 3918 if (c < 0xA1 || c > 0xFE) |
| 3919 goto invalid_code; | |
| 3920 ONE_MORE_BYTE (c1); | |
| 3921 if (c1 < 0x40 || (c1 > 0x7E && c1 < 0xA1) || c1 > 0xFE) | |
| 3922 goto invalid_code; | |
| 3923 c = c << 8 | c1; | |
| 3924 charset = charset_big5; | |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
3925 } |
| 88365 | 3926 CODING_DECODE_CHAR (coding, src, src_base, src_end, charset, c, c); |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
3927 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3928 |
| 88365 | 3929 *charbuf++ = c; |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
3930 continue; |
|
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
3931 |
| 88365 | 3932 invalid_code: |
| 17052 | 3933 src = src_base; |
| 88365 | 3934 consumed_chars = consumed_chars_base; |
| 3935 ONE_MORE_BYTE (c); | |
| 3936 *charbuf++ = ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); | |
| 3937 coding->errors++; | |
| 3938 } | |
| 3939 | |
| 3940 no_more_source: | |
| 3941 coding->consumed_char += consumed_chars_base; | |
| 3942 coding->consumed = src_base - coding->source; | |
| 3943 coding->charbuf_used = charbuf - coding->charbuf; | |
| 17052 | 3944 } |
| 3945 | |
| 3946 /* See the above "GENERAL NOTES on `encode_coding_XXX ()' functions". | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3947 This function can encode charsets `ascii', `katakana-jisx0201', |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3948 `japanese-jisx0208', `chinese-big5-1', and `chinese-big5-2'. We |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3949 are sure that all these charsets are registered as official charset |
| 17052 | 3950 (i.e. do not have extended leading-codes). Characters of other |
| 3951 charsets are produced without any encoding. If SJIS_P is 1, encode | |
| 3952 SJIS text, else encode BIG5 text. */ | |
| 3953 | |
| 88365 | 3954 static int |
| 3955 encode_coding_sjis (coding) | |
| 17052 | 3956 struct coding_system *coding; |
| 3957 { | |
| 88365 | 3958 int multibytep = coding->dst_multibyte; |
| 3959 int *charbuf = coding->charbuf; | |
| 3960 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 3961 unsigned char *dst = coding->destination + coding->produced; | |
| 3962 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 3963 int safe_room = 4; | |
| 3964 int produced_chars = 0; | |
| 3965 Lisp_Object attrs, eol_type, charset_list, val; | |
| 3966 int ascii_compatible; | |
| 3967 struct charset *charset_roman, *charset_kanji, *charset_kana; | |
| 3968 int c; | |
| 3969 | |
| 3970 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
| 3971 val = charset_list; | |
| 3972 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
| 3973 charset_kana = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
| 3974 charset_kanji = CHARSET_FROM_ID (XINT (XCAR (val))); | |
| 3975 | |
| 3976 ascii_compatible = ! NILP (CODING_ATTR_ASCII_COMPAT (attrs)); | |
| 3977 | |
| 3978 while (charbuf < charbuf_end) | |
| 3979 { | |
| 3980 ASSURE_DESTINATION (safe_room); | |
| 3981 c = *charbuf++; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3982 /* Now encode the character C. */ |
| 88365 | 3983 if (ASCII_CHAR_P (c) && ascii_compatible) |
| 3984 EMIT_ONE_ASCII_BYTE (c); | |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3985 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3986 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3987 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3988 EMIT_ONE_BYTE (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
3989 } |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3990 else |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
3991 { |
| 88365 | 3992 unsigned code; |
| 3993 struct charset *charset = char_charset (c, charset_list, &code); | |
| 3994 | |
| 3995 if (!charset) | |
| 3996 { | |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3997 if (coding->mode & CODING_MODE_SAFE_ENCODING) |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3998 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
3999 code = CODING_INHIBIT_CHARACTER_SUBSTITUTION; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4000 charset = CHARSET_FROM_ID (charset_ascii); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4001 } |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4002 else |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4003 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4004 c = coding->default_char; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4005 charset = char_charset (c, charset_list, &code); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4006 } |
| 88365 | 4007 } |
| 4008 if (code == CHARSET_INVALID_CODE (charset)) | |
| 4009 abort (); | |
| 4010 if (charset == charset_kanji) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4011 { |
| 88365 | 4012 int c1, c2; |
| 4013 JIS_TO_SJIS (code); | |
| 4014 c1 = code >> 8, c2 = code & 0xFF; | |
| 4015 EMIT_TWO_BYTES (c1, c2); | |
| 4016 } | |
| 4017 else if (charset == charset_kana) | |
| 4018 EMIT_ONE_BYTE (code | 0x80); | |
| 4019 else | |
| 4020 EMIT_ONE_ASCII_BYTE (code & 0x7F); | |
| 4021 } | |
| 4022 } | |
| 4023 coding->result = CODING_RESULT_SUCCESS; | |
| 4024 coding->produced_char += produced_chars; | |
| 4025 coding->produced = dst - coding->destination; | |
| 4026 return 0; | |
| 4027 } | |
| 4028 | |
| 4029 static int | |
| 4030 encode_coding_big5 (coding) | |
| 4031 struct coding_system *coding; | |
| 4032 { | |
| 4033 int multibytep = coding->dst_multibyte; | |
| 4034 int *charbuf = coding->charbuf; | |
| 4035 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 4036 unsigned char *dst = coding->destination + coding->produced; | |
| 4037 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 4038 int safe_room = 4; | |
| 4039 int produced_chars = 0; | |
| 4040 Lisp_Object attrs, eol_type, charset_list, val; | |
| 4041 int ascii_compatible; | |
| 4042 struct charset *charset_roman, *charset_big5; | |
| 4043 int c; | |
| 4044 | |
| 4045 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
| 4046 val = charset_list; | |
| 4047 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
| 4048 charset_big5 = CHARSET_FROM_ID (XINT (XCAR (val))); | |
| 4049 ascii_compatible = ! NILP (CODING_ATTR_ASCII_COMPAT (attrs)); | |
| 4050 | |
| 4051 while (charbuf < charbuf_end) | |
| 4052 { | |
| 4053 ASSURE_DESTINATION (safe_room); | |
| 4054 c = *charbuf++; | |
| 4055 /* Now encode the character C. */ | |
| 4056 if (ASCII_CHAR_P (c) && ascii_compatible) | |
| 4057 EMIT_ONE_ASCII_BYTE (c); | |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4058 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4059 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4060 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4061 EMIT_ONE_BYTE (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4062 } |
| 88365 | 4063 else |
| 4064 { | |
| 4065 unsigned code; | |
| 4066 struct charset *charset = char_charset (c, charset_list, &code); | |
| 4067 | |
| 4068 if (! charset) | |
| 4069 { | |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4070 if (coding->mode & CODING_MODE_SAFE_ENCODING) |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4071 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4072 code = CODING_INHIBIT_CHARACTER_SUBSTITUTION; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4073 charset = CHARSET_FROM_ID (charset_ascii); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4074 } |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4075 else |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4076 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4077 c = coding->default_char; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4078 charset = char_charset (c, charset_list, &code); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4079 } |
| 88365 | 4080 } |
| 4081 if (code == CHARSET_INVALID_CODE (charset)) | |
| 4082 abort (); | |
| 4083 if (charset == charset_big5) | |
| 4084 { | |
| 4085 int c1, c2; | |
| 4086 | |
| 4087 c1 = code >> 8, c2 = code & 0xFF; | |
| 4088 EMIT_TWO_BYTES (c1, c2); | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4089 } |
| 17052 | 4090 else |
| 88365 | 4091 EMIT_ONE_ASCII_BYTE (code & 0x7F); |
| 17052 | 4092 } |
| 88365 | 4093 } |
| 4094 coding->result = CODING_RESULT_SUCCESS; | |
| 4095 coding->produced_char += produced_chars; | |
| 4096 coding->produced = dst - coding->destination; | |
| 4097 return 0; | |
| 17052 | 4098 } |
| 4099 | |
| 4100 | |
| 88365 | 4101 /*** 10. CCL handlers ***/ |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4102 |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4103 /* See the above "GENERAL NOTES on `detect_coding_XXX ()' functions". |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4104 Check if a text is encoded in a coding system of which |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4105 encoder/decoder are written in CCL program. If it is, return |
| 88365 | 4106 CATEGORY_MASK_CCL, else return 0. */ |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4107 |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
4108 static int |
| 88365 | 4109 detect_coding_ccl (coding, mask) |
| 4110 struct coding_system *coding; | |
| 4111 int *mask; | |
| 4112 { | |
| 4113 unsigned char *src = coding->source, *src_base = src; | |
| 4114 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 4115 int multibytep = coding->src_multibyte; | |
| 4116 int consumed_chars = 0; | |
| 4117 int found = 0; | |
| 4118 unsigned char *valids = CODING_CCL_VALIDS (coding); | |
| 4119 int head_ascii = coding->head_ascii; | |
| 4120 Lisp_Object attrs; | |
| 4121 | |
| 4122 coding = &coding_categories[coding_category_ccl]; | |
| 4123 attrs = CODING_ID_ATTRS (coding->id); | |
| 4124 if (! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 4125 src += head_ascii; | |
| 4126 | |
| 4127 while (1) | |
| 4128 { | |
| 4129 int c; | |
| 4130 ONE_MORE_BYTE (c); | |
| 4131 if (! valids[c]) | |
| 4132 break; | |
| 4133 if (!found && valids[c] > 1) | |
| 4134 found = 1; | |
| 4135 } | |
| 4136 *mask &= ~CATEGORY_MASK_CCL; | |
| 4137 return 0; | |
| 4138 | |
| 4139 no_more_source: | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4140 return found; |
| 88365 | 4141 } |
| 4142 | |
| 4143 static void | |
| 4144 decode_coding_ccl (coding) | |
| 4145 struct coding_system *coding; | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4146 { |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
4147 const unsigned char *src = coding->source + coding->consumed; |
| 88365 | 4148 unsigned char *src_end = coding->source + coding->src_bytes; |
| 4149 int *charbuf = coding->charbuf; | |
| 4150 int *charbuf_end = charbuf + coding->charbuf_size; | |
| 4151 int consumed_chars = 0; | |
| 4152 int multibytep = coding->src_multibyte; | |
| 4153 struct ccl_program ccl; | |
| 4154 int source_charbuf[1024]; | |
| 4155 int source_byteidx[1024]; | |
| 4156 | |
| 4157 setup_ccl_program (&ccl, CODING_CCL_DECODER (coding)); | |
| 4158 | |
| 4159 while (src < src_end) | |
| 4160 { | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
4161 const unsigned char *p = src; |
| 88365 | 4162 int *source, *source_end; |
| 4163 int i = 0; | |
| 4164 | |
| 4165 if (multibytep) | |
| 4166 while (i < 1024 && p < src_end) | |
| 4167 { | |
| 4168 source_byteidx[i] = p - src; | |
| 4169 source_charbuf[i++] = STRING_CHAR_ADVANCE (p); | |
| 4170 } | |
| 4171 else | |
| 4172 while (i < 1024 && p < src_end) | |
| 4173 source_charbuf[i++] = *p++; | |
| 4174 | |
| 4175 if (p == src_end && coding->mode & CODING_MODE_LAST_BLOCK) | |
| 4176 ccl.last_block = 1; | |
| 4177 | |
| 4178 source = source_charbuf; | |
| 4179 source_end = source + i; | |
| 4180 while (source < source_end) | |
| 4181 { | |
| 4182 ccl_driver (&ccl, source, charbuf, | |
| 4183 source_end - source, charbuf_end - charbuf); | |
| 4184 source += ccl.consumed; | |
| 4185 charbuf += ccl.produced; | |
| 4186 if (ccl.status != CCL_STAT_SUSPEND_BY_DST) | |
| 4187 break; | |
| 4188 } | |
| 4189 if (source < source_end) | |
| 4190 src += source_byteidx[source - source_charbuf]; | |
| 4191 else | |
| 4192 src = p; | |
| 4193 consumed_chars += source - source_charbuf; | |
| 4194 | |
| 4195 if (ccl.status != CCL_STAT_SUSPEND_BY_SRC | |
| 4196 && ccl.status != CODING_RESULT_INSUFFICIENT_SRC) | |
| 4197 break; | |
| 4198 } | |
| 4199 | |
| 4200 switch (ccl.status) | |
| 4201 { | |
| 4202 case CCL_STAT_SUSPEND_BY_SRC: | |
| 4203 coding->result = CODING_RESULT_INSUFFICIENT_SRC; | |
| 4204 break; | |
| 4205 case CCL_STAT_SUSPEND_BY_DST: | |
| 4206 break; | |
| 4207 case CCL_STAT_QUIT: | |
| 4208 case CCL_STAT_INVALID_CMD: | |
| 4209 coding->result = CODING_RESULT_INTERRUPT; | |
| 4210 break; | |
| 4211 default: | |
| 4212 coding->result = CODING_RESULT_SUCCESS; | |
| 4213 break; | |
| 4214 } | |
| 4215 coding->consumed_char += consumed_chars; | |
| 4216 coding->consumed = src - coding->source; | |
| 4217 coding->charbuf_used = charbuf - coding->charbuf; | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4218 } |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4219 |
| 88365 | 4220 static int |
| 4221 encode_coding_ccl (coding) | |
| 4222 struct coding_system *coding; | |
| 4223 { | |
| 4224 struct ccl_program ccl; | |
| 4225 int multibytep = coding->dst_multibyte; | |
| 4226 int *charbuf = coding->charbuf; | |
| 4227 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 4228 unsigned char *dst = coding->destination + coding->produced; | |
| 4229 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 4230 unsigned char *adjusted_dst_end = dst_end - 1; | |
| 4231 int destination_charbuf[1024]; | |
| 4232 int i, produced_chars = 0; | |
| 4233 | |
| 4234 setup_ccl_program (&ccl, CODING_CCL_ENCODER (coding)); | |
| 4235 | |
| 4236 ccl.last_block = coding->mode & CODING_MODE_LAST_BLOCK; | |
| 4237 ccl.dst_multibyte = coding->dst_multibyte; | |
| 4238 | |
| 4239 while (charbuf < charbuf_end && dst < adjusted_dst_end) | |
| 4240 { | |
| 4241 int dst_bytes = dst_end - dst; | |
| 4242 if (dst_bytes > 1024) | |
| 4243 dst_bytes = 1024; | |
| 4244 | |
| 4245 ccl_driver (&ccl, charbuf, destination_charbuf, | |
| 4246 charbuf_end - charbuf, dst_bytes); | |
| 4247 charbuf += ccl.consumed; | |
| 4248 if (multibytep) | |
| 4249 for (i = 0; i < ccl.produced; i++) | |
| 4250 EMIT_ONE_BYTE (destination_charbuf[i] & 0xFF); | |
| 4251 else | |
| 4252 { | |
| 4253 for (i = 0; i < ccl.produced; i++) | |
| 4254 *dst++ = destination_charbuf[i] & 0xFF; | |
| 4255 produced_chars += ccl.produced; | |
| 4256 } | |
| 4257 } | |
| 4258 | |
| 4259 switch (ccl.status) | |
| 4260 { | |
| 4261 case CCL_STAT_SUSPEND_BY_SRC: | |
| 4262 coding->result = CODING_RESULT_INSUFFICIENT_SRC; | |
| 4263 break; | |
| 4264 case CCL_STAT_SUSPEND_BY_DST: | |
| 4265 coding->result = CODING_RESULT_INSUFFICIENT_DST; | |
| 4266 break; | |
| 4267 case CCL_STAT_QUIT: | |
| 4268 case CCL_STAT_INVALID_CMD: | |
| 4269 coding->result = CODING_RESULT_INTERRUPT; | |
| 4270 break; | |
| 4271 default: | |
| 4272 coding->result = CODING_RESULT_SUCCESS; | |
| 4273 break; | |
| 4274 } | |
| 4275 | |
| 4276 coding->produced_char += produced_chars; | |
| 4277 coding->produced = dst - coding->destination; | |
| 4278 return 0; | |
| 4279 } | |
| 4280 | |
| 4281 | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4282 |
| 88365 | 4283 /*** 10, 11. no-conversion handlers ***/ |
| 17052 | 4284 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4285 /* See the above "GENERAL NOTES on `decode_coding_XXX ()' functions". */ |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4286 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4287 static void |
| 88365 | 4288 decode_coding_raw_text (coding) |
| 17052 | 4289 struct coding_system *coding; |
| 4290 { | |
| 88365 | 4291 coding->chars_at_source = 1; |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
4292 coding->consumed_char = 0; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
4293 coding->consumed = 0; |
| 88365 | 4294 coding->result = CODING_RESULT_SUCCESS; |
| 4295 } | |
| 4296 | |
| 4297 static int | |
| 4298 encode_coding_raw_text (coding) | |
| 4299 struct coding_system *coding; | |
| 4300 { | |
| 4301 int multibytep = coding->dst_multibyte; | |
| 4302 int *charbuf = coding->charbuf; | |
| 4303 int *charbuf_end = coding->charbuf + coding->charbuf_used; | |
| 4304 unsigned char *dst = coding->destination + coding->produced; | |
| 4305 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 4306 int produced_chars = 0; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4307 int c; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4308 |
| 88365 | 4309 if (multibytep) |
| 4310 { | |
| 4311 int safe_room = MAX_MULTIBYTE_LENGTH * 2; | |
| 4312 | |
| 4313 if (coding->src_multibyte) | |
| 4314 while (charbuf < charbuf_end) | |
| 4315 { | |
| 4316 ASSURE_DESTINATION (safe_room); | |
| 4317 c = *charbuf++; | |
| 4318 if (ASCII_CHAR_P (c)) | |
| 4319 EMIT_ONE_ASCII_BYTE (c); | |
| 4320 else if (CHAR_BYTE8_P (c)) | |
| 4321 { | |
| 4322 c = CHAR_TO_BYTE8 (c); | |
| 4323 EMIT_ONE_BYTE (c); | |
| 4324 } | |
| 4325 else | |
| 4326 { | |
| 4327 unsigned char str[MAX_MULTIBYTE_LENGTH], *p0 = str, *p1 = str; | |
| 4328 | |
| 4329 CHAR_STRING_ADVANCE (c, p1); | |
| 4330 while (p0 < p1) | |
|
88950
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
4331 { |
|
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
4332 EMIT_ONE_BYTE (*p0); |
|
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
4333 p0++; |
|
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
4334 } |
| 88365 | 4335 } |
| 4336 } | |
| 4337 else | |
| 4338 while (charbuf < charbuf_end) | |
| 4339 { | |
| 4340 ASSURE_DESTINATION (safe_room); | |
| 4341 c = *charbuf++; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4342 EMIT_ONE_BYTE (c); |
| 88365 | 4343 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4344 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4345 else |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4346 { |
| 88365 | 4347 if (coding->src_multibyte) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4348 { |
| 88365 | 4349 int safe_room = MAX_MULTIBYTE_LENGTH; |
| 4350 | |
| 4351 while (charbuf < charbuf_end) | |
| 4352 { | |
| 4353 ASSURE_DESTINATION (safe_room); | |
| 4354 c = *charbuf++; | |
| 4355 if (ASCII_CHAR_P (c)) | |
| 4356 *dst++ = c; | |
| 4357 else if (CHAR_BYTE8_P (c)) | |
| 4358 *dst++ = CHAR_TO_BYTE8 (c); | |
| 4359 else | |
| 4360 CHAR_STRING_ADVANCE (c, dst); | |
| 4361 produced_chars++; | |
| 4362 } | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4363 } |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
4364 else |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4365 { |
| 88365 | 4366 ASSURE_DESTINATION (charbuf_end - charbuf); |
| 4367 while (charbuf < charbuf_end && dst < dst_end) | |
| 4368 *dst++ = *charbuf++; | |
| 4369 produced_chars = dst - (coding->destination + coding->dst_bytes); | |
| 4370 } | |
| 4371 } | |
| 4372 coding->result = CODING_RESULT_SUCCESS; | |
| 4373 coding->produced_char += produced_chars; | |
| 4374 coding->produced = dst - coding->destination; | |
| 4375 return 0; | |
| 4376 } | |
| 4377 | |
| 4378 static int | |
| 4379 detect_coding_charset (coding, mask) | |
| 4380 struct coding_system *coding; | |
| 4381 int *mask; | |
| 4382 { | |
| 4383 unsigned char *src = coding->source, *src_base = src; | |
| 4384 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 4385 int multibytep = coding->src_multibyte; | |
| 4386 int consumed_chars = 0; | |
| 4387 Lisp_Object attrs, valids; | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
4388 int found = 0; |
| 88365 | 4389 |
| 4390 coding = &coding_categories[coding_category_charset]; | |
| 4391 attrs = CODING_ID_ATTRS (coding->id); | |
| 4392 valids = AREF (attrs, coding_attr_charset_valids); | |
| 4393 | |
| 4394 if (! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 4395 src += coding->head_ascii; | |
| 4396 | |
| 4397 while (1) | |
| 4398 { | |
| 4399 int c; | |
| 4400 | |
| 4401 ONE_MORE_BYTE (c); | |
| 4402 if (NILP (AREF (valids, c))) | |
| 4403 break; | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
4404 if (c >= 0x80) |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
4405 found = 1; |
| 88365 | 4406 } |
| 4407 *mask &= ~CATEGORY_MASK_CHARSET; | |
| 4408 return 0; | |
| 4409 | |
| 4410 no_more_source: | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
4411 return (found || NILP (CODING_ATTR_ASCII_COMPAT (attrs))); |
| 88365 | 4412 } |
| 4413 | |
| 4414 static void | |
| 4415 decode_coding_charset (coding) | |
| 4416 struct coding_system *coding; | |
| 4417 { | |
| 4418 unsigned char *src = coding->source + coding->consumed; | |
| 4419 unsigned char *src_end = coding->source + coding->src_bytes; | |
| 4420 unsigned char *src_base; | |
| 4421 int *charbuf = coding->charbuf; | |
| 4422 int *charbuf_end = charbuf + coding->charbuf_size; | |
| 4423 int consumed_chars = 0, consumed_chars_base; | |
| 4424 int multibytep = coding->src_multibyte; | |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4425 Lisp_Object attrs, eol_type, charset_list, valids; |
| 88365 | 4426 |
| 4427 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4428 valids = AREF (attrs, coding_attr_charset_valids); |
| 88365 | 4429 |
| 4430 while (1) | |
| 4431 { | |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4432 int c; |
| 88365 | 4433 |
| 4434 src_base = src; | |
| 4435 consumed_chars_base = consumed_chars; | |
| 4436 | |
| 4437 if (charbuf >= charbuf_end) | |
| 4438 break; | |
| 4439 | |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4440 ONE_MORE_BYTE (c); |
| 88365 | 4441 if (c == '\r') |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4442 { |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4443 /* Here we assume that no charset maps '\r' to something |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4444 else. */ |
| 88365 | 4445 if (EQ (eol_type, Qdos)) |
| 4446 { | |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
4447 if (src == src_end) |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
4448 { |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
4449 coding->result = CODING_RESULT_INSUFFICIENT_SRC; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
4450 goto no_more_source; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
4451 } |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
4452 if (*src == '\n') |
| 88365 | 4453 ONE_MORE_BYTE (c); |
| 4454 } | |
| 4455 else if (EQ (eol_type, Qmac)) | |
| 4456 c = '\n'; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4457 } |
| 88365 | 4458 else |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4459 { |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4460 Lisp_Object val; |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4461 struct charset *charset; |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4462 int dim; |
|
88598
b88195f69856
(decode_coding_charset): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88597
diff
changeset
|
4463 int len = 1; |
|
b88195f69856
(decode_coding_charset): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88597
diff
changeset
|
4464 unsigned code = c; |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4465 |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4466 val = AREF (valids, c); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4467 if (NILP (val)) |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4468 goto invalid_code; |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4469 if (INTEGERP (val)) |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4470 { |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4471 charset = CHARSET_FROM_ID (XFASTINT (val)); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4472 dim = CHARSET_DIMENSION (charset); |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
4473 while (len < dim) |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4474 { |
|
88598
b88195f69856
(decode_coding_charset): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88597
diff
changeset
|
4475 ONE_MORE_BYTE (c); |
|
b88195f69856
(decode_coding_charset): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88597
diff
changeset
|
4476 code = (code << 8) | c; |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
4477 len++; |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4478 } |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4479 CODING_DECODE_CHAR (coding, src, src_base, src_end, |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4480 charset, code, c); |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4481 } |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4482 else |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4483 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4484 /* VAL is a list of charset IDs. It is assured that the |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4485 list is sorted by charset dimensions (smaller one |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4486 comes first). */ |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4487 while (CONSP (val)) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4488 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4489 charset = CHARSET_FROM_ID (XFASTINT (XCAR (val))); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4490 dim = CHARSET_DIMENSION (charset); |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
4491 while (len < dim) |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4492 { |
|
88598
b88195f69856
(decode_coding_charset): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88597
diff
changeset
|
4493 ONE_MORE_BYTE (c); |
|
b88195f69856
(decode_coding_charset): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88597
diff
changeset
|
4494 code = (code << 8) | c; |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
4495 len++; |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4496 } |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4497 CODING_DECODE_CHAR (coding, src, src_base, |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4498 src_end, charset, code, c); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4499 if (c >= 0) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4500 break; |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4501 val = XCDR (val); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4502 } |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
4503 } |
| 88365 | 4504 if (c < 0) |
| 4505 goto invalid_code; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
4506 } |
| 88365 | 4507 *charbuf++ = c; |
| 4508 continue; | |
| 4509 | |
| 4510 invalid_code: | |
| 4511 src = src_base; | |
| 4512 consumed_chars = consumed_chars_base; | |
| 4513 ONE_MORE_BYTE (c); | |
| 4514 *charbuf++ = ASCII_BYTE_P (c) ? c : BYTE8_TO_CHAR (c); | |
| 4515 coding->errors++; | |
| 4516 } | |
| 4517 | |
| 4518 no_more_source: | |
| 4519 coding->consumed_char += consumed_chars_base; | |
| 4520 coding->consumed = src_base - coding->source; | |
| 4521 coding->charbuf_used = charbuf - coding->charbuf; | |
| 4522 } | |
| 4523 | |
| 4524 static int | |
| 4525 encode_coding_charset (coding) | |
| 4526 struct coding_system *coding; | |
| 4527 { | |
| 4528 int multibytep = coding->dst_multibyte; | |
| 4529 int *charbuf = coding->charbuf; | |
| 4530 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 4531 unsigned char *dst = coding->destination + coding->produced; | |
| 4532 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 4533 int safe_room = MAX_MULTIBYTE_LENGTH; | |
| 4534 int produced_chars = 0; | |
| 4535 Lisp_Object attrs, eol_type, charset_list; | |
| 4536 int ascii_compatible; | |
| 4537 int c; | |
| 4538 | |
| 4539 CODING_GET_INFO (coding, attrs, eol_type, charset_list); | |
| 4540 ascii_compatible = ! NILP (CODING_ATTR_ASCII_COMPAT (attrs)); | |
| 4541 | |
| 4542 while (charbuf < charbuf_end) | |
| 4543 { | |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4544 struct charset *charset; |
| 88365 | 4545 unsigned code; |
| 4546 | |
| 4547 ASSURE_DESTINATION (safe_room); | |
| 4548 c = *charbuf++; | |
| 4549 if (ascii_compatible && ASCII_CHAR_P (c)) | |
| 4550 EMIT_ONE_ASCII_BYTE (c); | |
|
88690
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4551 else if (CHAR_BYTE8_P (c)) |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4552 { |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4553 c = CHAR_TO_BYTE8 (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4554 EMIT_ONE_BYTE (c); |
|
7f284ac55b07
(encode_coding_emacs_mule): Pay attention to raw-8-bit chars.
Kenichi Handa <handa@m17n.org>
parents:
88681
diff
changeset
|
4555 } |
| 88365 | 4556 else |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4557 { |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4558 charset = char_charset (c, charset_list, &code); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4559 if (charset) |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4560 { |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4561 if (CHARSET_DIMENSION (charset) == 1) |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4562 EMIT_ONE_BYTE (code); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4563 else if (CHARSET_DIMENSION (charset) == 2) |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4564 EMIT_TWO_BYTES (code >> 8, code & 0xFF); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4565 else if (CHARSET_DIMENSION (charset) == 3) |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4566 EMIT_THREE_BYTES (code >> 16, (code >> 8) & 0xFF, code & 0xFF); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4567 else |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4568 EMIT_FOUR_BYTES (code >> 24, (code >> 16) & 0xFF, |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4569 (code >> 8) & 0xFF, code & 0xFF); |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4570 } |
|
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4571 else |
|
88573
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4572 { |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4573 if (coding->mode & CODING_MODE_SAFE_ENCODING) |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4574 c = CODING_INHIBIT_CHARACTER_SUBSTITUTION; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4575 else |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4576 c = coding->default_char; |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4577 EMIT_ONE_BYTE (c); |
|
133bf7ab1bad
(encode_coding_iso_2022): If coding requires safe
Kenichi Handa <handa@m17n.org>
parents:
88544
diff
changeset
|
4578 } |
|
88465
ae455bb40718
(decode_coding_charset, encode_coding_charset): Handle
Kenichi Handa <handa@m17n.org>
parents:
88456
diff
changeset
|
4579 } |
| 88365 | 4580 } |
| 4581 | |
| 4582 coding->result = CODING_RESULT_SUCCESS; | |
| 4583 coding->produced_char += produced_chars; | |
| 4584 coding->produced = dst - coding->destination; | |
| 4585 return 0; | |
| 17052 | 4586 } |
| 4587 | |
| 4588 | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4589 /*** 7. C library functions ***/ |
| 17052 | 4590 |
| 88365 | 4591 /* Setup coding context CODING from information about CODING_SYSTEM. |
| 4592 If CODING_SYSTEM is nil, `no-conversion' is assumed. If | |
| 4593 CODING_SYSTEM is invalid, signal an error. */ | |
| 4594 | |
| 4595 void | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
4596 setup_coding_system (coding_system, coding) |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
4597 Lisp_Object coding_system; |
| 17052 | 4598 struct coding_system *coding; |
| 4599 { | |
| 88365 | 4600 Lisp_Object attrs; |
| 4601 Lisp_Object eol_type; | |
| 4602 Lisp_Object coding_type; | |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
4603 Lisp_Object val; |
| 17052 | 4604 |
|
24460
be35d27a4bfb
(setup_coding_system): Check for CODING_SYSTEM = nil.
Kenichi Handa <handa@m17n.org>
parents:
24425
diff
changeset
|
4605 if (NILP (coding_system)) |
| 88365 | 4606 coding_system = Qno_conversion; |
| 4607 | |
| 4608 CHECK_CODING_SYSTEM_GET_ID (coding_system, coding->id); | |
| 4609 | |
| 4610 attrs = CODING_ID_ATTRS (coding->id); | |
| 4611 eol_type = CODING_ID_EOL_TYPE (coding->id); | |
| 4612 | |
| 4613 coding->mode = 0; | |
| 4614 coding->head_ascii = -1; | |
| 4615 coding->common_flags | |
| 4616 = (VECTORP (eol_type) ? CODING_REQUIRE_DETECTION_MASK : 0); | |
| 4617 | |
| 4618 val = CODING_ATTR_SAFE_CHARSETS (attrs); | |
| 4619 coding->max_charset_id = XSTRING (val)->size - 1; | |
| 4620 coding->safe_charsets = (char *) XSTRING (val)->data; | |
| 4621 coding->default_char = XINT (CODING_ATTR_DEFAULT_CHAR (attrs)); | |
| 4622 | |
| 4623 coding_type = CODING_ATTR_TYPE (attrs); | |
| 4624 if (EQ (coding_type, Qundecided)) | |
| 4625 { | |
| 4626 coding->detector = NULL; | |
| 4627 coding->decoder = decode_coding_raw_text; | |
| 4628 coding->encoder = encode_coding_raw_text; | |
| 4629 coding->common_flags |= CODING_REQUIRE_DETECTION_MASK; | |
| 4630 } | |
| 4631 else if (EQ (coding_type, Qiso_2022)) | |
| 4632 { | |
| 4633 int i; | |
| 4634 int flags = XINT (AREF (attrs, coding_attr_iso_flags)); | |
| 4635 | |
| 4636 /* Invoke graphic register 0 to plane 0. */ | |
| 4637 CODING_ISO_INVOCATION (coding, 0) = 0; | |
| 4638 /* Invoke graphic register 1 to plane 1 if we can use 8-bit. */ | |
| 4639 CODING_ISO_INVOCATION (coding, 1) | |
| 4640 = (flags & CODING_ISO_FLAG_SEVEN_BITS ? -1 : 1); | |
| 4641 /* Setup the initial status of designation. */ | |
| 4642 for (i = 0; i < 4; i++) | |
| 4643 CODING_ISO_DESIGNATION (coding, i) = CODING_ISO_INITIAL (coding, i); | |
| 4644 /* Not single shifting initially. */ | |
| 4645 CODING_ISO_SINGLE_SHIFTING (coding) = 0; | |
| 4646 /* Beginning of buffer should also be regarded as bol. */ | |
| 4647 CODING_ISO_BOL (coding) = 1; | |
| 4648 coding->detector = detect_coding_iso_2022; | |
| 4649 coding->decoder = decode_coding_iso_2022; | |
| 4650 coding->encoder = encode_coding_iso_2022; | |
| 4651 if (flags & CODING_ISO_FLAG_SAFE) | |
| 4652 coding->mode |= CODING_MODE_SAFE_ENCODING; | |
|
20227
71008f909642
(setup_coding_system): Initialize common_flags member
Kenichi Handa <handa@m17n.org>
parents:
20150
diff
changeset
|
4653 coding->common_flags |
| 88365 | 4654 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK |
| 4655 | CODING_REQUIRE_FLUSHING_MASK); | |
| 4656 if (flags & CODING_ISO_FLAG_COMPOSITION) | |
| 4657 coding->common_flags |= CODING_ANNOTATE_COMPOSITION_MASK; | |
| 4658 if (flags & CODING_ISO_FLAG_FULL_SUPPORT) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4659 { |
| 88365 | 4660 setup_iso_safe_charsets (attrs); |
| 4661 val = CODING_ATTR_SAFE_CHARSETS (attrs); | |
| 4662 coding->max_charset_id = XSTRING (val)->size - 1; | |
| 4663 coding->safe_charsets = (char *) XSTRING (val)->data; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4664 } |
| 88365 | 4665 CODING_ISO_FLAGS (coding) = flags; |
| 4666 } | |
| 4667 else if (EQ (coding_type, Qcharset)) | |
| 4668 { | |
| 4669 coding->detector = detect_coding_charset; | |
| 4670 coding->decoder = decode_coding_charset; | |
| 4671 coding->encoder = encode_coding_charset; | |
| 4672 coding->common_flags | |
| 4673 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); | |
| 4674 } | |
| 4675 else if (EQ (coding_type, Qutf_8)) | |
| 4676 { | |
| 4677 coding->detector = detect_coding_utf_8; | |
| 4678 coding->decoder = decode_coding_utf_8; | |
| 4679 coding->encoder = encode_coding_utf_8; | |
|
34888
b469d29c0815
(SAFE_ONE_MORE_BYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34813
diff
changeset
|
4680 coding->common_flags |
| 88365 | 4681 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); |
| 4682 } | |
| 4683 else if (EQ (coding_type, Qutf_16)) | |
| 4684 { | |
| 4685 val = AREF (attrs, coding_attr_utf_16_bom); | |
| 4686 CODING_UTF_16_BOM (coding) = (CONSP (val) ? utf_16_detect_bom | |
| 4687 : EQ (val, Qt) ? utf_16_with_bom | |
| 4688 : utf_16_without_bom); | |
| 4689 val = AREF (attrs, coding_attr_utf_16_endian); | |
| 4690 CODING_UTF_16_ENDIAN (coding) = (NILP (val) ? utf_16_big_endian | |
| 4691 : utf_16_little_endian); | |
|
88438
3a34b722dd71
(encode_coding_utf_8): Initialize produced_chars to 0.
Kenichi Handa <handa@m17n.org>
parents:
88430
diff
changeset
|
4692 CODING_UTF_16_SURROGATE (coding) = 0; |
| 88365 | 4693 coding->detector = detect_coding_utf_16; |
| 4694 coding->decoder = decode_coding_utf_16; | |
| 4695 coding->encoder = encode_coding_utf_16; | |
|
20227
71008f909642
(setup_coding_system): Initialize common_flags member
Kenichi Handa <handa@m17n.org>
parents:
20150
diff
changeset
|
4696 coding->common_flags |
| 88365 | 4697 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); |
| 4698 } | |
| 4699 else if (EQ (coding_type, Qccl)) | |
| 4700 { | |
| 4701 coding->detector = detect_coding_ccl; | |
| 4702 coding->decoder = decode_coding_ccl; | |
| 4703 coding->encoder = encode_coding_ccl; | |
|
20227
71008f909642
(setup_coding_system): Initialize common_flags member
Kenichi Handa <handa@m17n.org>
parents:
20150
diff
changeset
|
4704 coding->common_flags |
| 88365 | 4705 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK |
| 4706 | CODING_REQUIRE_FLUSHING_MASK); | |
| 4707 } | |
| 4708 else if (EQ (coding_type, Qemacs_mule)) | |
| 4709 { | |
| 4710 coding->detector = detect_coding_emacs_mule; | |
| 4711 coding->decoder = decode_coding_emacs_mule; | |
| 4712 coding->encoder = encode_coding_emacs_mule; | |
| 4713 coding->common_flags | |
| 4714 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); | |
| 4715 if (! NILP (AREF (attrs, coding_attr_emacs_mule_full)) | |
| 4716 && ! EQ (CODING_ATTR_CHARSET_LIST (attrs), Vemacs_mule_charset_list)) | |
| 4717 { | |
| 4718 Lisp_Object tail, safe_charsets; | |
| 4719 int max_charset_id = 0; | |
| 4720 | |
| 4721 for (tail = Vemacs_mule_charset_list; CONSP (tail); | |
| 4722 tail = XCDR (tail)) | |
| 4723 if (max_charset_id < XFASTINT (XCAR (tail))) | |
| 4724 max_charset_id = XFASTINT (XCAR (tail)); | |
| 4725 safe_charsets = Fmake_string (make_number (max_charset_id + 1), | |
| 4726 make_number (255)); | |
| 4727 for (tail = Vemacs_mule_charset_list; CONSP (tail); | |
| 4728 tail = XCDR (tail)) | |
| 4729 XSTRING (safe_charsets)->data[XFASTINT (XCAR (tail))] = 0; | |
| 4730 coding->max_charset_id = max_charset_id; | |
| 4731 coding->safe_charsets = (char *) XSTRING (safe_charsets)->data; | |
| 4732 } | |
| 4733 } | |
| 4734 else if (EQ (coding_type, Qshift_jis)) | |
| 4735 { | |
| 4736 coding->detector = detect_coding_sjis; | |
| 4737 coding->decoder = decode_coding_sjis; | |
| 4738 coding->encoder = encode_coding_sjis; | |
| 4739 coding->common_flags | |
| 4740 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); | |
| 4741 } | |
| 4742 else if (EQ (coding_type, Qbig5)) | |
| 4743 { | |
| 4744 coding->detector = detect_coding_big5; | |
| 4745 coding->decoder = decode_coding_big5; | |
| 4746 coding->encoder = encode_coding_big5; | |
|
20227
71008f909642
(setup_coding_system): Initialize common_flags member
Kenichi Handa <handa@m17n.org>
parents:
20150
diff
changeset
|
4747 coding->common_flags |
| 88365 | 4748 |= (CODING_REQUIRE_DECODING_MASK | CODING_REQUIRE_ENCODING_MASK); |
| 4749 } | |
| 4750 else /* EQ (coding_type, Qraw_text) */ | |
| 4751 { | |
| 4752 coding->detector = NULL; | |
| 4753 coding->decoder = decode_coding_raw_text; | |
| 4754 coding->encoder = encode_coding_raw_text; | |
| 4755 coding->common_flags |= CODING_FOR_UNIBYTE_MASK; | |
| 4756 } | |
| 4757 | |
| 4758 return; | |
| 17052 | 4759 } |
| 4760 | |
| 88365 | 4761 /* Return raw-text or one of its subsidiaries that has the same |
| 4762 eol_type as CODING-SYSTEM. */ | |
| 4763 | |
| 4764 Lisp_Object | |
| 4765 raw_text_coding_system (coding_system) | |
| 4766 Lisp_Object coding_system; | |
| 26847 | 4767 { |
|
88430
6418a272b97e
* coding.c: Delete unused variables.
Kenichi Handa <handa@m17n.org>
parents:
88365
diff
changeset
|
4768 Lisp_Object spec, attrs; |
| 88365 | 4769 Lisp_Object eol_type, raw_text_eol_type; |
| 4770 | |
| 4771 spec = CODING_SYSTEM_SPEC (coding_system); | |
| 4772 attrs = AREF (spec, 0); | |
| 4773 | |
| 4774 if (EQ (CODING_ATTR_TYPE (attrs), Qraw_text)) | |
| 4775 return coding_system; | |
| 4776 | |
| 4777 eol_type = AREF (spec, 2); | |
| 4778 if (VECTORP (eol_type)) | |
| 4779 return Qraw_text; | |
| 4780 spec = CODING_SYSTEM_SPEC (Qraw_text); | |
| 4781 raw_text_eol_type = AREF (spec, 2); | |
| 4782 return (EQ (eol_type, Qunix) ? AREF (raw_text_eol_type, 0) | |
| 4783 : EQ (eol_type, Qdos) ? AREF (raw_text_eol_type, 1) | |
| 4784 : AREF (raw_text_eol_type, 2)); | |
| 26847 | 4785 } |
| 4786 | |
| 88365 | 4787 |
| 4788 /* If CODING_SYSTEM doesn't specify end-of-line format but PARENT | |
| 4789 does, return one of the subsidiary that has the same eol-spec as | |
| 4790 PARENT. Otherwise, return CODING_SYSTEM. */ | |
| 4791 | |
| 4792 Lisp_Object | |
| 4793 coding_inherit_eol_type (coding_system, parent) | |
| 88473 | 4794 Lisp_Object coding_system, parent; |
|
22616
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
4795 { |
| 88365 | 4796 Lisp_Object spec, attrs, eol_type; |
| 4797 | |
| 4798 spec = CODING_SYSTEM_SPEC (coding_system); | |
| 4799 attrs = AREF (spec, 0); | |
| 4800 eol_type = AREF (spec, 2); | |
| 4801 if (VECTORP (eol_type)) | |
| 4802 { | |
| 4803 Lisp_Object parent_spec; | |
| 4804 Lisp_Object parent_eol_type; | |
| 4805 | |
| 4806 parent_spec | |
| 4807 = CODING_SYSTEM_SPEC (buffer_defaults.buffer_file_coding_system); | |
| 4808 parent_eol_type = AREF (parent_spec, 2); | |
| 4809 if (EQ (parent_eol_type, Qunix)) | |
| 4810 coding_system = AREF (eol_type, 0); | |
| 4811 else if (EQ (parent_eol_type, Qdos)) | |
| 4812 coding_system = AREF (eol_type, 1); | |
| 4813 else if (EQ (parent_eol_type, Qmac)) | |
| 4814 coding_system = AREF (eol_type, 2); | |
| 4815 } | |
| 4816 return coding_system; | |
|
22616
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
4817 } |
|
c493ce6a31e4
(setup_raw_text_coding_system): New function.
Kenichi Handa <handa@m17n.org>
parents:
22529
diff
changeset
|
4818 |
| 17052 | 4819 /* Emacs has a mechanism to automatically detect a coding system if it |
| 4820 is one of Emacs' internal format, ISO2022, SJIS, and BIG5. But, | |
| 4821 it's impossible to distinguish some coding systems accurately | |
| 4822 because they use the same range of codes. So, at first, coding | |
| 4823 systems are categorized into 7, those are: | |
| 4824 | |
|
17835
f36ffb6f1208
Name change through the code:
Kenichi Handa <handa@m17n.org>
parents:
17725
diff
changeset
|
4825 o coding-category-emacs-mule |
| 17052 | 4826 |
| 4827 The category for a coding system which has the same code range | |
| 4828 as Emacs' internal format. Assigned the coding-system (Lisp | |
|
17835
f36ffb6f1208
Name change through the code:
Kenichi Handa <handa@m17n.org>
parents:
17725
diff
changeset
|
4829 symbol) `emacs-mule' by default. |
| 17052 | 4830 |
| 4831 o coding-category-sjis | |
| 4832 | |
| 4833 The category for a coding system which has the same code range | |
| 4834 as SJIS. Assigned the coding-system (Lisp | |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4835 symbol) `japanese-shift-jis' by default. |
| 17052 | 4836 |
| 4837 o coding-category-iso-7 | |
| 4838 | |
| 4839 The category for a coding system which has the same code range | |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4840 as ISO2022 of 7-bit environment. This doesn't use any locking |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4841 shift and single shift functions. This can encode/decode all |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4842 charsets. Assigned the coding-system (Lisp symbol) |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4843 `iso-2022-7bit' by default. |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4844 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4845 o coding-category-iso-7-tight |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4846 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4847 Same as coding-category-iso-7 except that this can |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4848 encode/decode only the specified charsets. |
| 17052 | 4849 |
| 4850 o coding-category-iso-8-1 | |
| 4851 | |
| 4852 The category for a coding system which has the same code range | |
| 4853 as ISO2022 of 8-bit environment and graphic plane 1 used only | |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4854 for DIMENSION1 charset. This doesn't use any locking shift |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4855 and single shift functions. Assigned the coding-system (Lisp |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4856 symbol) `iso-latin-1' by default. |
| 17052 | 4857 |
| 4858 o coding-category-iso-8-2 | |
| 4859 | |
| 4860 The category for a coding system which has the same code range | |
| 4861 as ISO2022 of 8-bit environment and graphic plane 1 used only | |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4862 for DIMENSION2 charset. This doesn't use any locking shift |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4863 and single shift functions. Assigned the coding-system (Lisp |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4864 symbol) `japanese-iso-8bit' by default. |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4865 |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4866 o coding-category-iso-7-else |
| 17052 | 4867 |
| 4868 The category for a coding system which has the same code range | |
| 88365 | 4869 as ISO2022 of 7-bit environemnt but uses locking shift or |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4870 single shift functions. Assigned the coding-system (Lisp |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4871 symbol) `iso-2022-7bit-lock' by default. |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4872 |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4873 o coding-category-iso-8-else |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4874 |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4875 The category for a coding system which has the same code range |
| 88365 | 4876 as ISO2022 of 8-bit environemnt but uses locking shift or |
|
18787
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4877 single shift functions. Assigned the coding-system (Lisp |
|
954e6be0a757
(detect_coding_iso2022): Distinguish coding-category-iso-7-else and
Kenichi Handa <handa@m17n.org>
parents:
18766
diff
changeset
|
4878 symbol) `iso-2022-8bit-ss2' by default. |
| 17052 | 4879 |
| 4880 o coding-category-big5 | |
| 4881 | |
| 4882 The category for a coding system which has the same code range | |
| 4883 as BIG5. Assigned the coding-system (Lisp symbol) | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
4884 `cn-big5' by default. |
| 17052 | 4885 |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4886 o coding-category-utf-8 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4887 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4888 The category for a coding system which has the same code range |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4889 as UTF-8 (cf. RFC2279). Assigned the coding-system (Lisp |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4890 symbol) `utf-8' by default. |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4891 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4892 o coding-category-utf-16-be |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4893 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4894 The category for a coding system in which a text has an |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4895 Unicode signature (cf. Unicode Standard) in the order of BIG |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4896 endian at the head. Assigned the coding-system (Lisp symbol) |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4897 `utf-16-be' by default. |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4898 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4899 o coding-category-utf-16-le |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4900 |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4901 The category for a coding system in which a text has an |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4902 Unicode signature (cf. Unicode Standard) in the order of |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4903 LITTLE endian at the head. Assigned the coding-system (Lisp |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4904 symbol) `utf-16-le' by default. |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
4905 |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4906 o coding-category-ccl |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4907 |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4908 The category for a coding system of which encoder/decoder is |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4909 written in CCL programs. The default value is nil, i.e., no |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4910 coding system is assigned. |
|
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
4911 |
| 17052 | 4912 o coding-category-binary |
| 4913 | |
| 4914 The category for a coding system not categorized in any of the | |
| 4915 above. Assigned the coding-system (Lisp symbol) | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
4916 `no-conversion' by default. |
| 17052 | 4917 |
| 4918 Each of them is a Lisp symbol and the value is an actual | |
| 88365 | 4919 `coding-system's (this is also a Lisp symbol) assigned by a user. |
| 17052 | 4920 What Emacs does actually is to detect a category of coding system. |
| 4921 Then, it uses a `coding-system' assigned to it. If Emacs can't | |
| 88365 | 4922 decide only one possible category, it selects a category of the |
| 17052 | 4923 highest priority. Priorities of categories are also specified by a |
| 4924 user in a Lisp variable `coding-category-list'. | |
| 4925 | |
| 4926 */ | |
| 4927 | |
| 88365 | 4928 #define EOL_SEEN_NONE 0 |
| 4929 #define EOL_SEEN_LF 1 | |
| 4930 #define EOL_SEEN_CR 2 | |
| 4931 #define EOL_SEEN_CRLF 4 | |
| 4932 | |
| 4933 /* Detect how end-of-line of a text of length CODING->src_bytes | |
| 4934 pointed by CODING->source is encoded. Return one of | |
| 4935 EOL_SEEN_XXX. */ | |
| 17052 | 4936 |
|
19173
04ed7c3f5cee
(detect_eol_type): If EOL representation does not
Richard M. Stallman <rms@gnu.org>
parents:
19134
diff
changeset
|
4937 #define MAX_EOL_CHECK_COUNT 3 |
|
04ed7c3f5cee
(detect_eol_type): If EOL representation does not
Richard M. Stallman <rms@gnu.org>
parents:
19134
diff
changeset
|
4938 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4939 static int |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4940 detect_eol (source, src_bytes, category) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4941 unsigned char *source; |
| 88365 | 4942 EMACS_INT src_bytes; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4943 enum coding_category category; |
| 17052 | 4944 { |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4945 unsigned char *src = source, *src_end = src + src_bytes; |
| 17052 | 4946 unsigned char c; |
| 88365 | 4947 int total = 0; |
| 4948 int eol_seen = EOL_SEEN_NONE; | |
| 4949 | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4950 if ((1 << category) & CATEGORY_MASK_UTF_16) |
| 88365 | 4951 { |
| 4952 int msb, lsb; | |
| 4953 | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4954 msb = category == (coding_category_utf_16_le |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
4955 | coding_category_utf_16_le_nosig); |
| 88365 | 4956 lsb = 1 - msb; |
| 4957 | |
| 4958 while (src + 1 < src_end) | |
| 17052 | 4959 { |
| 88365 | 4960 c = src[lsb]; |
| 4961 if (src[msb] == 0 && (c == '\n' || c == '\r')) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
4962 { |
| 88365 | 4963 int this_eol; |
| 4964 | |
| 4965 if (c == '\n') | |
| 4966 this_eol = EOL_SEEN_LF; | |
| 4967 else if (src + 3 >= src_end | |
| 4968 || src[msb + 2] != 0 | |
| 4969 || src[lsb + 2] != '\n') | |
| 4970 this_eol = EOL_SEEN_CR; | |
| 4971 else | |
| 4972 this_eol = EOL_SEEN_CRLF; | |
| 4973 | |
| 4974 if (eol_seen == EOL_SEEN_NONE) | |
| 4975 /* This is the first end-of-line. */ | |
| 4976 eol_seen = this_eol; | |
| 4977 else if (eol_seen != this_eol) | |
| 4978 { | |
| 4979 /* The found type is different from what found before. */ | |
| 4980 eol_seen = EOL_SEEN_LF; | |
| 4981 break; | |
| 4982 } | |
| 4983 if (++total == MAX_EOL_CHECK_COUNT) | |
| 4984 break; | |
| 4985 } | |
| 4986 src += 2; | |
| 4987 } | |
| 4988 } | |
| 4989 else | |
| 4990 { | |
| 4991 while (src < src_end) | |
| 4992 { | |
| 4993 c = *src++; | |
| 4994 if (c == '\n' || c == '\r') | |
| 4995 { | |
| 4996 int this_eol; | |
| 4997 | |
| 4998 if (c == '\n') | |
| 4999 this_eol = EOL_SEEN_LF; | |
| 5000 else if (src >= src_end || *src != '\n') | |
| 5001 this_eol = EOL_SEEN_CR; | |
| 5002 else | |
| 5003 this_eol = EOL_SEEN_CRLF, src++; | |
| 5004 | |
| 5005 if (eol_seen == EOL_SEEN_NONE) | |
| 5006 /* This is the first end-of-line. */ | |
| 5007 eol_seen = this_eol; | |
| 5008 else if (eol_seen != this_eol) | |
| 5009 { | |
| 5010 /* The found type is different from what found before. */ | |
| 5011 eol_seen = EOL_SEEN_LF; | |
| 5012 break; | |
| 5013 } | |
| 5014 if (++total == MAX_EOL_CHECK_COUNT) | |
| 5015 break; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5016 } |
| 17052 | 5017 } |
| 5018 } | |
| 88365 | 5019 return eol_seen; |
| 17052 | 5020 } |
| 5021 | |
| 88365 | 5022 |
| 5023 static void | |
| 5024 adjust_coding_eol_type (coding, eol_seen) | |
| 5025 struct coding_system *coding; | |
| 5026 int eol_seen; | |
| 5027 { | |
|
88430
6418a272b97e
* coding.c: Delete unused variables.
Kenichi Handa <handa@m17n.org>
parents:
88365
diff
changeset
|
5028 Lisp_Object eol_type; |
| 88365 | 5029 |
| 5030 eol_type = CODING_ID_EOL_TYPE (coding->id); | |
| 5031 if (eol_seen & EOL_SEEN_LF) | |
| 5032 coding->id = CODING_SYSTEM_ID (AREF (eol_type, 0)); | |
|
88862
108e2535280d
(adjust_coding_eol_type): Fix eol_type/eol_seen mixup.
Dave Love <fx@gnu.org>
parents:
88856
diff
changeset
|
5033 else if (eol_seen & EOL_SEEN_CRLF) |
| 88365 | 5034 coding->id = CODING_SYSTEM_ID (AREF (eol_type, 1)); |
|
88862
108e2535280d
(adjust_coding_eol_type): Fix eol_type/eol_seen mixup.
Dave Love <fx@gnu.org>
parents:
88856
diff
changeset
|
5035 else if (eol_seen & EOL_SEEN_CR) |
| 88365 | 5036 coding->id = CODING_SYSTEM_ID (AREF (eol_type, 2)); |
| 5037 } | |
| 5038 | |
| 5039 /* Detect how a text specified in CODING is encoded. If a coding | |
| 5040 system is detected, update fields of CODING by the detected coding | |
| 5041 system. */ | |
| 5042 | |
| 5043 void | |
| 5044 detect_coding (coding) | |
| 5045 struct coding_system *coding; | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5046 { |
| 88365 | 5047 unsigned char *src, *src_end; |
| 5048 Lisp_Object attrs, coding_type; | |
| 5049 | |
| 5050 coding->consumed = coding->consumed_char = 0; | |
| 5051 coding->produced = coding->produced_char = 0; | |
| 5052 coding_set_source (coding); | |
| 5053 | |
| 5054 src_end = coding->source + coding->src_bytes; | |
| 5055 | |
| 5056 /* If we have not yet decided the text encoding type, detect it | |
| 5057 now. */ | |
| 5058 if (EQ (CODING_ATTR_TYPE (CODING_ID_ATTRS (coding->id)), Qundecided)) | |
| 5059 { | |
| 5060 int mask = CATEGORY_MASK_ANY; | |
| 5061 int c, i; | |
| 5062 | |
| 5063 for (src = coding->source; src < src_end; src++) | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5064 { |
| 88365 | 5065 c = *src; |
| 5066 if (c & 0x80 || (c < 0x20 && (c == ISO_CODE_ESC | |
| 5067 || c == ISO_CODE_SI | |
| 5068 || c == ISO_CODE_SO))) | |
| 5069 break; | |
| 5070 } | |
| 5071 coding->head_ascii = src - (coding->source + coding->consumed); | |
| 5072 | |
| 5073 if (coding->head_ascii < coding->src_bytes) | |
| 5074 { | |
| 5075 int detected = 0; | |
| 5076 | |
| 5077 for (i = 0; i < coding_category_raw_text; i++) | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5078 { |
| 88365 | 5079 enum coding_category category = coding_priorities[i]; |
| 5080 struct coding_system *this = coding_categories + category; | |
| 5081 | |
| 5082 if (this->id < 0) | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5083 { |
| 88365 | 5084 /* No coding system of this category is defined. */ |
| 5085 mask &= ~(1 << category); | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5086 } |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5087 else if (category >= coding_category_raw_text |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5088 || detected & (1 << category)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5089 continue; |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5090 else |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5091 { |
| 88365 | 5092 detected |= detected_mask[category]; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5093 if ((*(this->detector)) (coding, &mask) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5094 && (mask & (1 << category))) |
|
89221
e6779a6185ca
(detect_coding): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89218
diff
changeset
|
5095 { |
|
e6779a6185ca
(detect_coding): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89218
diff
changeset
|
5096 mask = 1 << category; |
|
e6779a6185ca
(detect_coding): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89218
diff
changeset
|
5097 break; |
|
e6779a6185ca
(detect_coding): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89218
diff
changeset
|
5098 } |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5099 } |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5100 } |
| 88365 | 5101 if (! mask) |
| 5102 setup_coding_system (Qraw_text, coding); | |
| 5103 else if (mask != CATEGORY_MASK_ANY) | |
| 5104 for (i = 0; i < coding_category_raw_text; i++) | |
| 5105 { | |
| 5106 enum coding_category category = coding_priorities[i]; | |
| 5107 struct coding_system *this = coding_categories + category; | |
| 5108 | |
| 5109 if (mask & (1 << category)) | |
| 5110 { | |
| 5111 setup_coding_system (CODING_ID_NAME (this->id), coding); | |
| 5112 break; | |
| 5113 } | |
| 5114 } | |
| 5115 } | |
| 5116 } | |
| 5117 | |
| 5118 attrs = CODING_ID_ATTRS (coding->id); | |
| 5119 coding_type = CODING_ATTR_TYPE (attrs); | |
| 5120 | |
| 5121 /* If we have not yet decided the EOL type, detect it now. But, the | |
| 5122 detection is impossible for a CCL based coding system, in which | |
| 5123 case, we detct the EOL type after decoding. */ | |
| 5124 if (VECTORP (CODING_ID_EOL_TYPE (coding->id)) | |
| 5125 && ! EQ (coding_type, Qccl)) | |
| 5126 { | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5127 int eol_seen = detect_eol (coding->source, coding->src_bytes, |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
5128 XINT (CODING_ATTR_CATEGORY (attrs))); |
| 88365 | 5129 |
| 5130 if (eol_seen != EOL_SEEN_NONE) | |
| 5131 adjust_coding_eol_type (coding, eol_seen); | |
| 5132 } | |
| 5133 } | |
| 5134 | |
| 5135 | |
| 5136 static void | |
| 5137 decode_eol (coding) | |
| 5138 struct coding_system *coding; | |
| 5139 { | |
| 5140 if (VECTORP (CODING_ID_EOL_TYPE (coding->id))) | |
| 5141 { | |
| 5142 unsigned char *p = CHAR_POS_ADDR (coding->dst_pos); | |
| 5143 unsigned char *pend = p + coding->produced; | |
| 5144 int eol_seen = EOL_SEEN_NONE; | |
| 5145 | |
| 5146 for (; p < pend; p++) | |
| 5147 { | |
| 5148 if (*p == '\n') | |
| 5149 eol_seen |= EOL_SEEN_LF; | |
| 5150 else if (*p == '\r') | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5151 { |
| 88365 | 5152 if (p + 1 < pend && *(p + 1) == '\n') |
| 5153 { | |
| 5154 eol_seen |= EOL_SEEN_CRLF; | |
| 5155 p++; | |
| 5156 } | |
| 5157 else | |
| 5158 eol_seen |= EOL_SEEN_CR; | |
|
28022
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5159 } |
|
6c41f3276340
Add comments on coding-category-utf-8,
Kenichi Handa <handa@m17n.org>
parents:
27943
diff
changeset
|
5160 } |
| 88365 | 5161 if (eol_seen != EOL_SEEN_NONE) |
| 5162 adjust_coding_eol_type (coding, eol_seen); | |
| 5163 } | |
| 5164 | |
| 5165 if (EQ (CODING_ID_EOL_TYPE (coding->id), Qmac)) | |
| 5166 { | |
| 5167 unsigned char *p = CHAR_POS_ADDR (coding->dst_pos); | |
| 5168 unsigned char *pend = p + coding->produced; | |
| 5169 | |
| 5170 for (; p < pend; p++) | |
| 5171 if (*p == '\r') | |
| 5172 *p = '\n'; | |
| 5173 } | |
| 5174 else if (EQ (CODING_ID_EOL_TYPE (coding->id), Qdos)) | |
| 5175 { | |
| 5176 unsigned char *p, *pbeg, *pend; | |
| 5177 Lisp_Object undo_list; | |
| 5178 | |
| 5179 move_gap_both (coding->dst_pos + coding->produced_char, | |
| 5180 coding->dst_pos_byte + coding->produced); | |
| 5181 undo_list = current_buffer->undo_list; | |
| 5182 current_buffer->undo_list = Qt; | |
| 88856 | 5183 del_range_2 (coding->dst_pos, coding->dst_pos_byte, GPT, GPT_BYTE, 0); |
| 88365 | 5184 current_buffer->undo_list = undo_list; |
| 5185 pbeg = GPT_ADDR; | |
| 5186 pend = pbeg + coding->produced; | |
| 5187 | |
| 5188 for (p = pend - 1; p >= pbeg; p--) | |
| 5189 if (*p == '\r') | |
| 5190 { | |
| 5191 safe_bcopy ((char *) (p + 1), (char *) p, pend - p - 1); | |
| 5192 pend--; | |
| 5193 } | |
| 5194 coding->produced_char -= coding->produced - (pend - pbeg); | |
| 5195 coding->produced = pend - pbeg; | |
| 5196 insert_from_gap (coding->produced_char, coding->produced); | |
| 17052 | 5197 } |
| 5198 } | |
| 5199 | |
| 88365 | 5200 static void |
| 5201 translate_chars (coding, table) | |
| 17052 | 5202 struct coding_system *coding; |
| 88365 | 5203 Lisp_Object table; |
| 17052 | 5204 { |
| 88365 | 5205 int *charbuf = coding->charbuf; |
| 5206 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 5207 int c; | |
| 5208 | |
| 5209 if (coding->chars_at_source) | |
| 5210 return; | |
| 5211 | |
| 5212 while (charbuf < charbuf_end) | |
| 5213 { | |
| 5214 c = *charbuf; | |
| 5215 if (c < 0) | |
| 5216 charbuf += c; | |
| 5217 else | |
| 5218 *charbuf++ = translate_char (table, c); | |
| 5219 } | |
| 17052 | 5220 } |
| 5221 | |
| 88365 | 5222 static int |
| 5223 produce_chars (coding) | |
| 5224 struct coding_system *coding; | |
| 17052 | 5225 { |
| 88365 | 5226 unsigned char *dst = coding->destination + coding->produced; |
| 5227 unsigned char *dst_end = coding->destination + coding->dst_bytes; | |
| 5228 int produced; | |
| 5229 int produced_chars = 0; | |
| 5230 | |
| 5231 if (! coding->chars_at_source) | |
| 5232 { | |
| 5233 /* Characters are in coding->charbuf. */ | |
| 5234 int *buf = coding->charbuf; | |
| 5235 int *buf_end = buf + coding->charbuf_used; | |
| 5236 unsigned char *adjusted_dst_end; | |
| 5237 | |
| 5238 if (BUFFERP (coding->src_object) | |
| 5239 && EQ (coding->src_object, coding->dst_object)) | |
| 5240 dst_end = coding->source + coding->consumed; | |
| 5241 adjusted_dst_end = dst_end - MAX_MULTIBYTE_LENGTH; | |
| 5242 | |
| 5243 while (buf < buf_end) | |
| 5244 { | |
| 5245 int c = *buf++; | |
| 5246 | |
| 5247 if (dst >= adjusted_dst_end) | |
| 5248 { | |
| 5249 dst = alloc_destination (coding, | |
| 5250 buf_end - buf + MAX_MULTIBYTE_LENGTH, | |
| 5251 dst); | |
| 5252 dst_end = coding->destination + coding->dst_bytes; | |
| 5253 adjusted_dst_end = dst_end - MAX_MULTIBYTE_LENGTH; | |
| 5254 } | |
| 5255 if (c >= 0) | |
| 5256 { | |
| 5257 if (coding->dst_multibyte | |
| 5258 || ! CHAR_BYTE8_P (c)) | |
| 5259 CHAR_STRING_ADVANCE (c, dst); | |
| 5260 else | |
| 5261 *dst++ = CHAR_TO_BYTE8 (c); | |
| 5262 produced_chars++; | |
| 5263 } | |
| 5264 else | |
| 5265 /* This is an annotation data. */ | |
| 5266 buf -= c + 1; | |
| 5267 } | |
|
30833
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
5268 } |
|
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
5269 else |
|
2db6e42a6ba3
(MINIMUM_CONVERSION_BUFFER_SIZE): Macro deleted.
Kenichi Handa <handa@m17n.org>
parents:
30756
diff
changeset
|
5270 { |
| 88365 | 5271 unsigned char *src = coding->source; |
| 5272 unsigned char *src_end = src + coding->src_bytes; | |
| 5273 Lisp_Object eol_type; | |
| 5274 | |
| 5275 eol_type = CODING_ID_EOL_TYPE (coding->id); | |
| 5276 | |
| 5277 if (coding->src_multibyte != coding->dst_multibyte) | |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5278 { |
| 88365 | 5279 if (coding->src_multibyte) |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5280 { |
|
88443
6b86cf30a0b9
(produce_chars): Set the variable `multibytep' correctly.
Kenichi Handa <handa@m17n.org>
parents:
88438
diff
changeset
|
5281 int multibytep = 1; |
| 88365 | 5282 int consumed_chars; |
| 5283 | |
| 5284 while (1) | |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5285 { |
| 88365 | 5286 unsigned char *src_base = src; |
| 5287 int c; | |
| 5288 | |
| 5289 ONE_MORE_BYTE (c); | |
| 5290 if (c == '\r') | |
| 5291 { | |
| 5292 if (EQ (eol_type, Qdos)) | |
| 5293 { | |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5294 if (src == src_end) |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5295 { |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5296 coding->result = CODING_RESULT_INSUFFICIENT_SRC; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5297 goto no_more_source; |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5298 } |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5299 if (*src == '\n') |
| 88365 | 5300 c = *src++; |
| 5301 } | |
| 5302 else if (EQ (eol_type, Qmac)) | |
| 5303 c = '\n'; | |
| 5304 } | |
| 5305 if (dst == dst_end) | |
| 5306 { | |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5307 coding->consumed = src - coding->source; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5308 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5309 if (EQ (coding->src_object, coding->dst_object)) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5310 dst_end = src; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5311 if (dst == dst_end) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5312 { |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5313 dst = alloc_destination (coding, src_end - src + 1, |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5314 dst); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5315 dst_end = coding->destination + coding->dst_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5316 coding_set_source (coding); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5317 src = coding->source + coding->consumed; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5318 src_end = coding->source + coding->src_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5319 } |
| 88365 | 5320 } |
| 5321 *dst++ = c; | |
| 5322 produced_chars++; | |
| 5323 } | |
| 5324 no_more_source: | |
| 5325 ; | |
| 5326 } | |
| 5327 else | |
| 5328 while (src < src_end) | |
| 5329 { | |
|
88443
6b86cf30a0b9
(produce_chars): Set the variable `multibytep' correctly.
Kenichi Handa <handa@m17n.org>
parents:
88438
diff
changeset
|
5330 int multibytep = 1; |
| 88365 | 5331 int c = *src++; |
| 5332 | |
| 5333 if (c == '\r') | |
| 5334 { | |
| 5335 if (EQ (eol_type, Qdos)) | |
| 5336 { | |
| 5337 if (src < src_end | |
| 5338 && *src == '\n') | |
| 5339 c = *src++; | |
| 5340 } | |
| 5341 else if (EQ (eol_type, Qmac)) | |
| 5342 c = '\n'; | |
| 5343 } | |
| 5344 if (dst >= dst_end - 1) | |
| 5345 { | |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5346 coding->consumed = src - coding->source; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5347 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5348 if (EQ (coding->src_object, coding->dst_object)) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5349 dst_end = src; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5350 if (dst >= dst_end - 1) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5351 { |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5352 dst = alloc_destination (coding, src_end - src + 2, |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5353 dst); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5354 dst_end = coding->destination + coding->dst_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5355 coding_set_source (coding); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5356 src = coding->source + coding->consumed; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5357 src_end = coding->source + coding->src_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5358 } |
| 88365 | 5359 } |
| 5360 EMIT_ONE_BYTE (c); | |
| 5361 } | |
| 5362 } | |
| 5363 else | |
| 5364 { | |
| 5365 if (!EQ (coding->src_object, coding->dst_object)) | |
| 5366 { | |
| 5367 int require = coding->src_bytes - coding->dst_bytes; | |
| 5368 | |
| 5369 if (require > 0) | |
| 5370 { | |
| 5371 EMACS_INT offset = src - coding->source; | |
| 5372 | |
| 5373 dst = alloc_destination (coding, require, dst); | |
| 5374 coding_set_source (coding); | |
| 5375 src = coding->source + offset; | |
| 5376 src_end = coding->source + coding->src_bytes; | |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5377 } |
|
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5378 } |
| 88365 | 5379 produced_chars = coding->src_chars; |
| 5380 while (src < src_end) | |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5381 { |
| 88365 | 5382 int c = *src++; |
| 5383 | |
| 5384 if (c == '\r') | |
| 5385 { | |
| 5386 if (EQ (eol_type, Qdos)) | |
| 5387 { | |
| 5388 if (src < src_end | |
| 5389 && *src == '\n') | |
| 5390 c = *src++; | |
| 5391 produced_chars--; | |
| 5392 } | |
| 5393 else if (EQ (eol_type, Qmac)) | |
| 5394 c = '\n'; | |
| 5395 } | |
| 5396 *dst++ = c; | |
|
34892
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5397 } |
|
3868f2e7355a
(setup_coding_system): Initialize
Kenichi Handa <handa@m17n.org>
parents:
34888
diff
changeset
|
5398 } |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5399 coding->consumed = coding->src_bytes; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
5400 coding->consumed_char = coding->src_chars; |
| 88365 | 5401 } |
| 5402 | |
| 5403 produced = dst - (coding->destination + coding->produced); | |
| 5404 if (BUFFERP (coding->dst_object)) | |
| 5405 insert_from_gap (produced_chars, produced); | |
| 5406 coding->produced += produced; | |
| 5407 coding->produced_char += produced_chars; | |
| 5408 return produced_chars; | |
| 5409 } | |
| 5410 | |
| 5411 /* [ -LENGTH CHAR_POS_OFFSET MASK METHOD COMP_LEN ] | |
| 5412 or | |
| 5413 [ -LENGTH CHAR_POS_OFFSET MASK METHOD COMP_LEN COMPONENTS... ] | |
| 5414 */ | |
| 5415 | |
| 5416 static INLINE void | |
| 5417 produce_composition (coding, charbuf) | |
| 5418 struct coding_system *coding; | |
| 5419 int *charbuf; | |
| 5420 { | |
| 5421 Lisp_Object buffer; | |
| 5422 int len; | |
| 5423 EMACS_INT pos; | |
| 5424 enum composition_method method; | |
| 5425 int cmp_len; | |
| 5426 Lisp_Object components; | |
| 5427 | |
| 5428 buffer = coding->dst_object; | |
| 5429 len = -charbuf[0]; | |
| 5430 pos = coding->dst_pos + charbuf[1]; | |
| 5431 method = (enum composition_method) (charbuf[3]); | |
| 5432 cmp_len = charbuf[4]; | |
| 5433 | |
| 5434 if (method == COMPOSITION_RELATIVE) | |
| 5435 components = Qnil; | |
| 5436 else | |
| 5437 { | |
| 5438 Lisp_Object args[MAX_COMPOSITION_COMPONENTS * 2 - 1]; | |
| 5439 int i; | |
| 5440 | |
| 5441 len -= 5; | |
| 5442 charbuf += 5; | |
| 5443 for (i = 0; i < len; i++) | |
| 5444 args[i] = make_number (charbuf[i]); | |
| 5445 components = (method == COMPOSITION_WITH_ALTCHARS | |
| 5446 ? Fstring (len, args) : Fvector (len, args)); | |
| 5447 } | |
| 5448 compose_text (pos, pos + cmp_len, components, Qnil, Qnil); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5449 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5450 |
| 88365 | 5451 static int * |
| 5452 save_composition_data (buf, buf_end, prop) | |
| 5453 int *buf, *buf_end; | |
| 5454 Lisp_Object prop; | |
| 5455 { | |
| 5456 enum composition_method method = COMPOSITION_METHOD (prop); | |
| 5457 int cmp_len = COMPOSITION_LENGTH (prop); | |
| 5458 | |
| 5459 if (buf + 4 + (MAX_COMPOSITION_COMPONENTS * 2 - 1) > buf_end) | |
| 5460 return NULL; | |
| 5461 | |
| 5462 buf[1] = CODING_ANNOTATE_COMPOSITION_MASK; | |
| 5463 buf[2] = method; | |
| 5464 buf[3] = cmp_len; | |
| 5465 | |
| 5466 if (method == COMPOSITION_RELATIVE) | |
| 5467 buf[0] = 4; | |
| 5468 else | |
| 5469 { | |
| 5470 Lisp_Object components; | |
| 5471 int len, i; | |
| 5472 | |
| 5473 components = COMPOSITION_COMPONENTS (prop); | |
| 5474 if (VECTORP (components)) | |
| 5475 { | |
| 5476 len = XVECTOR (components)->size; | |
| 5477 for (i = 0; i < len; i++) | |
| 5478 buf[4 + i] = XINT (AREF (components, i)); | |
| 5479 } | |
| 5480 else if (STRINGP (components)) | |
| 5481 { | |
| 5482 int i_byte; | |
| 5483 | |
| 5484 len = XSTRING (components)->size; | |
| 5485 i = i_byte = 0; | |
| 5486 while (i < len) | |
| 5487 FETCH_STRING_CHAR_ADVANCE (buf[4 + i], components, i, i_byte); | |
| 5488 } | |
| 5489 else if (INTEGERP (components)) | |
| 5490 { | |
| 5491 len = 1; | |
| 5492 buf[4] = XINT (components); | |
| 5493 } | |
| 5494 else if (CONSP (components)) | |
| 5495 { | |
| 5496 for (len = 0; CONSP (components); | |
| 5497 len++, components = XCDR (components)) | |
| 5498 buf[4 + len] = XINT (XCAR (components)); | |
| 5499 } | |
| 5500 else | |
| 5501 abort (); | |
| 5502 buf[0] = 4 + len; | |
| 5503 } | |
| 5504 return (buf + buf[0]); | |
| 5505 } | |
| 5506 | |
| 5507 #define CHARBUF_SIZE 0x4000 | |
| 5508 | |
| 5509 #define ALLOC_CONVERSION_WORK_AREA(coding) \ | |
| 5510 do { \ | |
| 5511 int size = CHARBUF_SIZE;; \ | |
| 5512 \ | |
| 5513 coding->charbuf = NULL; \ | |
| 5514 while (size > 1024) \ | |
| 5515 { \ | |
| 5516 coding->charbuf = (int *) alloca (sizeof (int) * size); \ | |
| 5517 if (coding->charbuf) \ | |
| 5518 break; \ | |
| 5519 size >>= 1; \ | |
| 5520 } \ | |
| 5521 if (! coding->charbuf) \ | |
| 5522 { \ | |
| 5523 coding->result = CODING_RESULT_INSUFFICIENT_MEM; \ | |
| 5524 return coding->result; \ | |
| 5525 } \ | |
| 5526 coding->charbuf_size = size; \ | |
| 5527 } while (0) | |
| 5528 | |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5529 |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5530 static void |
| 88365 | 5531 produce_annotation (coding) |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5532 struct coding_system *coding; |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5533 { |
| 88365 | 5534 int *charbuf = coding->charbuf; |
| 5535 int *charbuf_end = charbuf + coding->charbuf_used; | |
| 5536 | |
| 5537 while (charbuf < charbuf_end) | |
| 5538 { | |
| 5539 if (*charbuf >= 0) | |
| 5540 charbuf++; | |
| 5541 else | |
|
29877
7b43e1fb478a
(decode_eol_post_ccl): Special handling for undecided
Eli Zaretskii <eliz@gnu.org>
parents:
29725
diff
changeset
|
5542 { |
| 88365 | 5543 int len = -*charbuf; |
| 5544 switch (charbuf[2]) | |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5545 { |
| 88365 | 5546 case CODING_ANNOTATE_COMPOSITION_MASK: |
| 5547 produce_composition (coding, charbuf); | |
| 5548 break; | |
| 5549 default: | |
| 5550 abort (); | |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5551 } |
| 88365 | 5552 charbuf += len; |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5553 } |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5554 } |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5555 } |
|
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5556 |
| 88365 | 5557 /* Decode the data at CODING->src_object into CODING->dst_object. |
| 5558 CODING->src_object is a buffer, a string, or nil. | |
| 5559 CODING->dst_object is a buffer. | |
| 5560 | |
| 5561 If CODING->src_object is a buffer, it must be the current buffer. | |
| 5562 In this case, if CODING->src_pos is positive, it is a position of | |
| 5563 the source text in the buffer, otherwise, the source text is in the | |
| 5564 gap area of the buffer, and CODING->src_pos specifies the offset of | |
| 5565 the text from GPT (which must be the same as PT). If this is the | |
| 5566 same buffer as CODING->dst_object, CODING->src_pos must be | |
| 5567 negative. | |
| 5568 | |
| 5569 If CODING->src_object is a string, CODING->src_pos in an index to | |
| 5570 that string. | |
| 5571 | |
| 5572 If CODING->src_object is nil, CODING->source must already point to | |
| 5573 the non-relocatable memory area. In this case, CODING->src_pos is | |
| 5574 an offset from CODING->source. | |
| 5575 | |
| 5576 The decoded data is inserted at the current point of the buffer | |
| 5577 CODING->dst_object. | |
| 5578 */ | |
| 5579 | |
| 5580 static int | |
| 5581 decode_coding (coding) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5582 struct coding_system *coding; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5583 { |
| 88365 | 5584 Lisp_Object attrs; |
| 5585 | |
| 5586 if (BUFFERP (coding->src_object) | |
| 5587 && coding->src_pos > 0 | |
| 5588 && coding->src_pos < GPT | |
| 5589 && coding->src_pos + coding->src_chars > GPT) | |
| 5590 move_gap_both (coding->src_pos, coding->src_pos_byte); | |
| 5591 | |
| 5592 if (BUFFERP (coding->dst_object)) | |
| 5593 { | |
| 5594 if (current_buffer != XBUFFER (coding->dst_object)) | |
| 5595 set_buffer_internal (XBUFFER (coding->dst_object)); | |
| 5596 if (GPT != PT) | |
| 5597 move_gap_both (PT, PT_BYTE); | |
| 5598 } | |
| 5599 | |
| 5600 coding->consumed = coding->consumed_char = 0; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
5601 coding->produced = coding->produced_char = 0; |
| 88365 | 5602 coding->chars_at_source = 0; |
| 5603 coding->result = CODING_RESULT_SUCCESS; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
5604 coding->errors = 0; |
| 88365 | 5605 |
| 5606 ALLOC_CONVERSION_WORK_AREA (coding); | |
| 5607 | |
| 5608 attrs = CODING_ID_ATTRS (coding->id); | |
| 5609 | |
| 5610 do | |
| 5611 { | |
| 5612 coding_set_source (coding); | |
| 5613 coding->annotated = 0; | |
| 5614 (*(coding->decoder)) (coding); | |
| 5615 if (!NILP (CODING_ATTR_DECODE_TBL (attrs))) | |
|
89207
c232917f49f7
(decode_coding): Fix args to translate_chars. Pay
Kenichi Handa <handa@m17n.org>
parents:
89193
diff
changeset
|
5616 translate_chars (coding, CODING_ATTR_DECODE_TBL (attrs)); |
|
c232917f49f7
(decode_coding): Fix args to translate_chars. Pay
Kenichi Handa <handa@m17n.org>
parents:
89193
diff
changeset
|
5617 else if (!NILP (Vstandard_translation_table_for_decode)) |
|
c232917f49f7
(decode_coding): Fix args to translate_chars. Pay
Kenichi Handa <handa@m17n.org>
parents:
89193
diff
changeset
|
5618 translate_chars (coding, Vstandard_translation_table_for_decode); |
| 88365 | 5619 coding_set_destination (coding); |
| 5620 produce_chars (coding); | |
| 5621 if (coding->annotated) | |
| 5622 produce_annotation (coding); | |
| 5623 } | |
| 5624 while (coding->consumed < coding->src_bytes | |
| 5625 && ! coding->result); | |
| 5626 | |
| 5627 if (EQ (CODING_ATTR_TYPE (CODING_ID_ATTRS (coding->id)), Qccl) | |
| 5628 && SYMBOLP (CODING_ID_EOL_TYPE (coding->id)) | |
| 5629 && ! EQ (CODING_ID_EOL_TYPE (coding->id), Qunix)) | |
| 5630 decode_eol (coding); | |
| 5631 | |
| 5632 coding->carryover_bytes = 0; | |
| 5633 if (coding->consumed < coding->src_bytes) | |
| 5634 { | |
| 5635 int nbytes = coding->src_bytes - coding->consumed; | |
| 5636 unsigned char *src; | |
| 5637 | |
| 5638 coding_set_source (coding); | |
| 5639 coding_set_destination (coding); | |
| 5640 src = coding->source + coding->consumed; | |
| 5641 | |
| 5642 if (coding->mode & CODING_MODE_LAST_BLOCK) | |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5643 { |
| 88365 | 5644 /* Flush out unprocessed data as binary chars. We are sure |
| 5645 that the number of data is less than the size of | |
| 5646 coding->charbuf. */ | |
| 5647 while (nbytes-- > 0) | |
| 5648 { | |
| 5649 int c = *src++; | |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5650 |
|
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5651 coding->charbuf[coding->charbuf_used++] = (c & 0x80 ? - c : c); |
| 88365 | 5652 } |
| 5653 produce_chars (coding); | |
|
29725
2bc397e9b09a
(setup_coding_system) <4>: Reset member `cr_carryover'.
Kenichi Handa <handa@m17n.org>
parents:
29663
diff
changeset
|
5654 } |
| 88365 | 5655 else |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5656 { |
| 88365 | 5657 /* Record unprocessed bytes in coding->carryover. We are |
| 5658 sure that the number of data is less than the size of | |
| 5659 coding->carryover. */ | |
| 5660 unsigned char *p = coding->carryover; | |
| 5661 | |
| 5662 coding->carryover_bytes = nbytes; | |
| 5663 while (nbytes-- > 0) | |
| 5664 *p++ = *src++; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5665 } |
| 88365 | 5666 coding->consumed = coding->src_bytes; |
| 5667 } | |
| 5668 | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
5669 return coding->result; |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5670 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5671 |
| 88365 | 5672 static void |
| 5673 consume_chars (coding) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5674 struct coding_system *coding; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5675 { |
| 88365 | 5676 int *buf = coding->charbuf; |
| 5677 /* -1 is to compensate for CRLF. */ | |
| 5678 int *buf_end = coding->charbuf + coding->charbuf_size - 1; | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
5679 const unsigned char *src = coding->source + coding->consumed; |
| 88365 | 5680 int pos = coding->src_pos + coding->consumed_char; |
| 5681 int end_pos = coding->src_pos + coding->src_chars; | |
| 5682 int multibytep = coding->src_multibyte; | |
| 5683 Lisp_Object eol_type; | |
| 5684 int c; | |
| 5685 int start, end, stop; | |
| 5686 Lisp_Object object, prop; | |
| 5687 | |
| 5688 eol_type = CODING_ID_EOL_TYPE (coding->id); | |
| 5689 if (VECTORP (eol_type)) | |
| 5690 eol_type = Qunix; | |
| 5691 | |
| 5692 object = coding->src_object; | |
| 5693 | |
| 5694 /* Note: composition handling is not yet implemented. */ | |
| 5695 coding->common_flags &= ~CODING_ANNOTATE_COMPOSITION_MASK; | |
| 5696 | |
| 5697 if (coding->common_flags & CODING_ANNOTATE_COMPOSITION_MASK | |
| 5698 && find_composition (pos, end_pos, &start, &end, &prop, object) | |
| 5699 && end <= end_pos | |
| 5700 && (start >= pos | |
| 5701 || (find_composition (end, end_pos, &start, &end, &prop, object) | |
| 5702 && end <= end_pos))) | |
| 5703 stop = start; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5704 else |
| 88365 | 5705 stop = end_pos; |
| 5706 | |
| 5707 while (buf < buf_end) | |
| 5708 { | |
| 5709 if (pos == stop) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5710 { |
| 88365 | 5711 int *p; |
| 5712 | |
| 5713 if (pos == end_pos) | |
| 5714 break; | |
| 5715 p = save_composition_data (buf, buf_end, prop); | |
| 5716 if (p == NULL) | |
| 5717 break; | |
| 5718 buf = p; | |
| 5719 if (find_composition (end, end_pos, &start, &end, &prop, object) | |
| 5720 && end <= end_pos) | |
| 5721 stop = start; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5722 else |
| 88365 | 5723 stop = end_pos; |
| 5724 } | |
| 5725 | |
| 5726 if (! multibytep) | |
| 5727 c = *src++; | |
| 5728 else | |
| 5729 c = STRING_CHAR_ADVANCE (src); | |
| 5730 if ((c == '\r') && (coding->mode & CODING_MODE_SELECTIVE_DISPLAY)) | |
| 5731 c = '\n'; | |
| 5732 if (! EQ (eol_type, Qunix)) | |
| 5733 { | |
| 5734 if (c == '\n') | |
| 5735 { | |
| 5736 if (EQ (eol_type, Qdos)) | |
| 5737 *buf++ = '\r'; | |
| 5738 else | |
| 5739 c = '\r'; | |
| 5740 } | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5741 } |
| 88365 | 5742 *buf++ = c; |
| 5743 pos++; | |
| 5744 } | |
| 5745 | |
| 5746 coding->consumed = src - coding->source; | |
| 5747 coding->consumed_char = pos - coding->src_pos; | |
| 5748 coding->charbuf_used = buf - coding->charbuf; | |
| 5749 coding->chars_at_source = 0; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5750 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5751 |
| 88365 | 5752 |
| 5753 /* Encode the text at CODING->src_object into CODING->dst_object. | |
| 5754 CODING->src_object is a buffer or a string. | |
| 5755 CODING->dst_object is a buffer or nil. | |
| 5756 | |
| 5757 If CODING->src_object is a buffer, it must be the current buffer. | |
| 5758 In this case, if CODING->src_pos is positive, it is a position of | |
| 5759 the source text in the buffer, otherwise. the source text is in the | |
| 5760 gap area of the buffer, and coding->src_pos specifies the offset of | |
| 5761 the text from GPT (which must be the same as PT). If this is the | |
| 5762 same buffer as CODING->dst_object, CODING->src_pos must be | |
| 5763 negative and CODING should not have `pre-write-conversion'. | |
| 5764 | |
| 5765 If CODING->src_object is a string, CODING should not have | |
| 5766 `pre-write-conversion'. | |
| 5767 | |
| 5768 If CODING->dst_object is a buffer, the encoded data is inserted at | |
| 5769 the current point of that buffer. | |
| 5770 | |
| 5771 If CODING->dst_object is nil, the encoded data is placed at the | |
| 5772 memory area specified by CODING->destination. */ | |
| 5773 | |
| 5774 static int | |
| 5775 encode_coding (coding) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5776 struct coding_system *coding; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5777 { |
| 88365 | 5778 Lisp_Object attrs; |
| 5779 | |
| 5780 attrs = CODING_ID_ATTRS (coding->id); | |
| 5781 | |
| 5782 if (BUFFERP (coding->dst_object)) | |
| 5783 { | |
| 5784 set_buffer_internal (XBUFFER (coding->dst_object)); | |
| 5785 coding->dst_multibyte | |
| 5786 = ! NILP (current_buffer->enable_multibyte_characters); | |
| 5787 } | |
| 5788 | |
| 5789 coding->consumed = coding->consumed_char = 0; | |
| 5790 coding->produced = coding->produced_char = 0; | |
| 5791 coding->result = CODING_RESULT_SUCCESS; | |
| 5792 coding->errors = 0; | |
| 5793 | |
| 5794 ALLOC_CONVERSION_WORK_AREA (coding); | |
| 5795 | |
| 5796 do { | |
| 5797 coding_set_source (coding); | |
| 5798 consume_chars (coding); | |
| 5799 | |
| 5800 if (!NILP (CODING_ATTR_ENCODE_TBL (attrs))) | |
|
89207
c232917f49f7
(decode_coding): Fix args to translate_chars. Pay
Kenichi Handa <handa@m17n.org>
parents:
89193
diff
changeset
|
5801 translate_chars (coding, CODING_ATTR_ENCODE_TBL (attrs)); |
|
c232917f49f7
(decode_coding): Fix args to translate_chars. Pay
Kenichi Handa <handa@m17n.org>
parents:
89193
diff
changeset
|
5802 else if (!NILP (Vstandard_translation_table_for_encode)) |
|
c232917f49f7
(decode_coding): Fix args to translate_chars. Pay
Kenichi Handa <handa@m17n.org>
parents:
89193
diff
changeset
|
5803 translate_chars (coding, Vstandard_translation_table_for_encode); |
| 88365 | 5804 |
| 5805 coding_set_destination (coding); | |
| 5806 (*(coding->encoder)) (coding); | |
| 5807 } while (coding->consumed_char < coding->src_chars); | |
| 5808 | |
| 5809 if (BUFFERP (coding->dst_object)) | |
| 5810 insert_from_gap (coding->produced_char, coding->produced); | |
| 5811 | |
| 5812 return (coding->result); | |
| 5813 } | |
| 5814 | |
| 5815 /* Work buffer */ | |
| 5816 | |
| 5817 /* List of currently used working buffer. */ | |
| 5818 Lisp_Object Vcode_conversion_work_buf_list; | |
| 5819 | |
| 5820 /* A working buffer used by the top level conversion. */ | |
| 5821 Lisp_Object Vcode_conversion_reused_work_buf; | |
| 5822 | |
| 5823 | |
| 5824 /* Return a working buffer that can be freely used by the following | |
| 5825 code conversion. MULTIBYTEP specifies the multibyteness of the | |
| 5826 buffer. */ | |
| 5827 | |
| 5828 Lisp_Object | |
| 5829 make_conversion_work_buffer (multibytep) | |
| 5830 int multibytep; | |
| 5831 { | |
| 5832 struct buffer *current = current_buffer; | |
| 5833 Lisp_Object buf; | |
| 5834 | |
| 5835 if (NILP (Vcode_conversion_work_buf_list)) | |
| 5836 { | |
| 5837 if (NILP (Vcode_conversion_reused_work_buf)) | |
| 5838 Vcode_conversion_reused_work_buf | |
| 5839 = Fget_buffer_create (build_string (" *code-conversion-work*")); | |
| 5840 Vcode_conversion_work_buf_list | |
| 5841 = Fcons (Vcode_conversion_reused_work_buf, Qnil); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5842 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5843 else |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5844 { |
| 88856 | 5845 int depth = XINT (Flength (Vcode_conversion_work_buf_list)); |
| 88365 | 5846 char str[128]; |
| 5847 | |
| 5848 sprintf (str, " *code-conversion-work*<%d>", depth); | |
| 5849 Vcode_conversion_work_buf_list | |
| 5850 = Fcons (Fget_buffer_create (build_string (str)), | |
| 5851 Vcode_conversion_work_buf_list); | |
| 5852 } | |
| 5853 | |
| 5854 buf = XCAR (Vcode_conversion_work_buf_list); | |
| 5855 set_buffer_internal (XBUFFER (buf)); | |
| 5856 current_buffer->undo_list = Qt; | |
| 5857 Ferase_buffer (); | |
|
88950
ad258ee59fbb
* coding.c (make_conversion_work_buffer): Adjusted for the change
Kenichi Handa <handa@m17n.org>
parents:
88936
diff
changeset
|
5858 Fset_buffer_multibyte (multibytep ? Qt : Qnil, Qnil); |
| 88365 | 5859 set_buffer_internal (current); |
| 5860 return buf; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5861 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
5862 |
| 88365 | 5863 static struct coding_system *saved_coding; |
| 5864 | |
| 5865 Lisp_Object | |
| 5866 code_conversion_restore (info) | |
| 5867 Lisp_Object info; | |
|
26067
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
5868 { |
| 88856 | 5869 int depth = XINT (Flength (Vcode_conversion_work_buf_list)); |
| 88365 | 5870 Lisp_Object buf; |
| 5871 | |
| 5872 if (depth > 0) | |
| 5873 { | |
| 5874 buf = XCAR (Vcode_conversion_work_buf_list); | |
| 5875 Vcode_conversion_work_buf_list = XCDR (Vcode_conversion_work_buf_list); | |
| 5876 if (depth > 1 && !NILP (Fbuffer_live_p (buf))) | |
| 5877 Fkill_buffer (buf); | |
| 5878 } | |
| 5879 | |
| 88856 | 5880 if (EQ (saved_coding->dst_object, Qt) |
| 88365 | 5881 && saved_coding->destination) |
| 5882 xfree (saved_coding->destination); | |
| 5883 | |
| 5884 return save_excursion_restore (info); | |
|
26067
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
5885 } |
|
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
5886 |
| 88365 | 5887 |
| 5888 int | |
| 5889 decode_coding_gap (coding, chars, bytes) | |
| 26847 | 5890 struct coding_system *coding; |
| 88365 | 5891 EMACS_INT chars, bytes; |
| 5892 { | |
| 5893 int count = specpdl_ptr - specpdl; | |
| 5894 | |
| 5895 saved_coding = coding; | |
| 5896 record_unwind_protect (code_conversion_restore, save_excursion_save ()); | |
| 5897 | |
| 5898 coding->src_object = Fcurrent_buffer (); | |
| 5899 coding->src_chars = chars; | |
| 5900 coding->src_bytes = bytes; | |
| 5901 coding->src_pos = -chars; | |
| 5902 coding->src_pos_byte = -bytes; | |
| 5903 coding->src_multibyte = chars < bytes; | |
| 5904 coding->dst_object = coding->src_object; | |
| 5905 coding->dst_pos = PT; | |
| 5906 coding->dst_pos_byte = PT_BYTE; | |
|
88443
6b86cf30a0b9
(produce_chars): Set the variable `multibytep' correctly.
Kenichi Handa <handa@m17n.org>
parents:
88438
diff
changeset
|
5907 coding->dst_multibyte = ! NILP (current_buffer->enable_multibyte_characters); |
|
89279
1fd77c471ee6
(decode_coding_utf_8): When eol_type is Qdos, handle
Kenichi Handa <handa@m17n.org>
parents:
89227
diff
changeset
|
5908 coding->mode |= CODING_MODE_LAST_BLOCK; |
| 88365 | 5909 |
| 5910 if (CODING_REQUIRE_DETECTION (coding)) | |
| 5911 detect_coding (coding); | |
| 5912 | |
| 5913 decode_coding (coding); | |
| 5914 | |
| 5915 unbind_to (count, Qnil); | |
| 5916 return coding->result; | |
| 5917 } | |
| 5918 | |
| 5919 int | |
| 5920 encode_coding_gap (coding, chars, bytes) | |
| 5921 struct coding_system *coding; | |
| 5922 EMACS_INT chars, bytes; | |
| 26847 | 5923 { |
| 88365 | 5924 int count = specpdl_ptr - specpdl; |
| 5925 Lisp_Object buffer; | |
| 5926 | |
| 5927 saved_coding = coding; | |
| 5928 record_unwind_protect (code_conversion_restore, save_excursion_save ()); | |
| 5929 | |
| 5930 buffer = Fcurrent_buffer (); | |
| 5931 coding->src_object = buffer; | |
| 5932 coding->src_chars = chars; | |
| 5933 coding->src_bytes = bytes; | |
| 5934 coding->src_pos = -chars; | |
| 5935 coding->src_pos_byte = -bytes; | |
| 5936 coding->src_multibyte = chars < bytes; | |
| 5937 coding->dst_object = coding->src_object; | |
| 5938 coding->dst_pos = PT; | |
| 5939 coding->dst_pos_byte = PT_BYTE; | |
| 5940 | |
| 5941 encode_coding (coding); | |
| 5942 | |
| 5943 unbind_to (count, Qnil); | |
| 5944 return coding->result; | |
| 26847 | 5945 } |
| 5946 | |
| 88365 | 5947 |
| 5948 /* Decode the text in the range FROM/FROM_BYTE and TO/TO_BYTE in | |
| 5949 SRC_OBJECT into DST_OBJECT by coding context CODING. | |
| 5950 | |
| 5951 SRC_OBJECT is a buffer, a string, or Qnil. | |
| 5952 | |
| 5953 If it is a buffer, the text is at point of the buffer. FROM and TO | |
| 5954 are positions in the buffer. | |
| 5955 | |
| 5956 If it is a string, the text is at the beginning of the string. | |
| 5957 FROM and TO are indices to the string. | |
| 5958 | |
| 5959 If it is nil, the text is at coding->source. FROM and TO are | |
| 5960 indices to coding->source. | |
| 5961 | |
| 5962 DST_OBJECT is a buffer, Qt, or Qnil. | |
| 5963 | |
| 5964 If it is a buffer, the decoded text is inserted at point of the | |
| 5965 buffer. If the buffer is the same as SRC_OBJECT, the source text | |
| 5966 is deleted. | |
| 5967 | |
| 5968 If it is Qt, a string is made from the decoded text, and | |
| 5969 set in CODING->dst_object. | |
| 5970 | |
| 5971 If it is Qnil, the decoded text is stored at CODING->destination. | |
| 5972 The called must allocate CODING->dst_bytes bytes at | |
| 5973 CODING->destination by xmalloc. If the decoded text is longer than | |
| 5974 CODING->dst_bytes, CODING->destination is relocated by xrealloc. | |
| 5975 */ | |
| 26847 | 5976 |
|
29275
b4ea9178e480
(DECODE_COMPOSITION_START): If coding->cmp_data is not
Kenichi Handa <handa@m17n.org>
parents:
29247
diff
changeset
|
5977 void |
| 88365 | 5978 decode_coding_object (coding, src_object, from, from_byte, to, to_byte, |
| 5979 dst_object) | |
| 26847 | 5980 struct coding_system *coding; |
| 88365 | 5981 Lisp_Object src_object; |
| 5982 EMACS_INT from, from_byte, to, to_byte; | |
| 5983 Lisp_Object dst_object; | |
| 26847 | 5984 { |
| 88365 | 5985 int count = specpdl_ptr - specpdl; |
| 5986 unsigned char *destination; | |
| 5987 EMACS_INT dst_bytes; | |
| 5988 EMACS_INT chars = to - from; | |
| 5989 EMACS_INT bytes = to_byte - from_byte; | |
| 5990 Lisp_Object attrs; | |
| 5991 | |
| 5992 saved_coding = coding; | |
| 5993 record_unwind_protect (code_conversion_restore, save_excursion_save ()); | |
| 5994 | |
| 5995 if (NILP (dst_object)) | |
| 5996 { | |
| 5997 destination = coding->destination; | |
| 5998 dst_bytes = coding->dst_bytes; | |
| 5999 } | |
| 6000 | |
| 6001 coding->src_object = src_object; | |
| 6002 coding->src_chars = chars; | |
| 6003 coding->src_bytes = bytes; | |
| 6004 coding->src_multibyte = chars < bytes; | |
| 6005 | |
| 6006 if (STRINGP (src_object)) | |
| 6007 { | |
| 6008 coding->src_pos = from; | |
| 6009 coding->src_pos_byte = from_byte; | |
| 6010 } | |
| 6011 else if (BUFFERP (src_object)) | |
| 6012 { | |
| 6013 set_buffer_internal (XBUFFER (src_object)); | |
| 6014 if (from != GPT) | |
| 6015 move_gap_both (from, from_byte); | |
| 6016 if (EQ (src_object, dst_object)) | |
| 26847 | 6017 { |
| 88365 | 6018 TEMP_SET_PT_BOTH (from, from_byte); |
| 6019 del_range_both (from, from_byte, to, to_byte, 1); | |
| 6020 coding->src_pos = -chars; | |
| 6021 coding->src_pos_byte = -bytes; | |
|
20931
068eb408c911
(decode_coding_iso2022): Update coding->fake_multibyte.
Kenichi Handa <handa@m17n.org>
parents:
20803
diff
changeset
|
6022 } |
|
42661
e85e4d9494b1
(code_convert_region): Don't copy old text if undo disabled.
Richard M. Stallman <rms@gnu.org>
parents:
42105
diff
changeset
|
6023 else |
|
e85e4d9494b1
(code_convert_region): Don't copy old text if undo disabled.
Richard M. Stallman <rms@gnu.org>
parents:
42105
diff
changeset
|
6024 { |
| 88365 | 6025 coding->src_pos = from; |
| 6026 coding->src_pos_byte = from_byte; | |
|
29985
c17e78d8c720
(code_convert_region): Even if the length of text is
Kenichi Handa <handa@m17n.org>
parents:
29932
diff
changeset
|
6027 } |
| 88365 | 6028 } |
| 6029 | |
| 6030 if (CODING_REQUIRE_DETECTION (coding)) | |
| 6031 detect_coding (coding); | |
| 6032 attrs = CODING_ID_ATTRS (coding->id); | |
| 6033 | |
| 6034 if (! NILP (CODING_ATTR_POST_READ (attrs)) | |
| 6035 || EQ (dst_object, Qt)) | |
| 6036 { | |
| 6037 coding->dst_object = make_conversion_work_buffer (1); | |
| 6038 coding->dst_pos = BEG; | |
| 6039 coding->dst_pos_byte = BEG_BYTE; | |
| 6040 coding->dst_multibyte = 1; | |
| 6041 } | |
| 6042 else if (BUFFERP (dst_object)) | |
| 6043 { | |
| 6044 coding->dst_object = dst_object; | |
| 6045 coding->dst_pos = BUF_PT (XBUFFER (dst_object)); | |
| 6046 coding->dst_pos_byte = BUF_PT_BYTE (XBUFFER (dst_object)); | |
| 6047 coding->dst_multibyte | |
| 6048 = ! NILP (XBUFFER (dst_object)->enable_multibyte_characters); | |
| 6049 } | |
| 6050 else | |
| 6051 { | |
| 6052 coding->dst_object = Qnil; | |
| 6053 coding->dst_multibyte = 1; | |
| 6054 } | |
| 6055 | |
| 6056 decode_coding (coding); | |
| 6057 | |
| 6058 if (BUFFERP (coding->dst_object)) | |
| 6059 set_buffer_internal (XBUFFER (coding->dst_object)); | |
| 6060 | |
| 6061 if (! NILP (CODING_ATTR_POST_READ (attrs))) | |
| 6062 { | |
| 6063 struct gcpro gcpro1, gcpro2; | |
| 6064 EMACS_INT prev_Z = Z, prev_Z_BYTE = Z_BYTE; | |
| 6065 Lisp_Object val; | |
| 6066 | |
|
88506
a7f0d13affa5
(decode_coding_object): Move point to coding->dst_pos before
Kenichi Handa <handa@m17n.org>
parents:
88497
diff
changeset
|
6067 TEMP_SET_PT_BOTH (coding->dst_pos, coding->dst_pos_byte); |
| 88365 | 6068 GCPRO2 (coding->src_object, coding->dst_object); |
| 6069 val = call1 (CODING_ATTR_POST_READ (attrs), | |
| 6070 make_number (coding->produced_char)); | |
| 6071 UNGCPRO; | |
| 6072 CHECK_NATNUM (val); | |
| 6073 coding->produced_char += Z - prev_Z; | |
| 6074 coding->produced += Z_BYTE - prev_Z_BYTE; | |
| 6075 } | |
| 6076 | |
| 6077 if (EQ (dst_object, Qt)) | |
| 6078 { | |
| 6079 coding->dst_object = Fbuffer_string (); | |
| 6080 } | |
| 6081 else if (NILP (dst_object) && BUFFERP (coding->dst_object)) | |
| 6082 { | |
| 6083 set_buffer_internal (XBUFFER (coding->dst_object)); | |
| 6084 if (dst_bytes < coding->produced) | |
|
42105
09cc243e2d14
(code_convert_region): Update coding->cmp_data->char_offset
Richard M. Stallman <rms@gnu.org>
parents:
42104
diff
changeset
|
6085 { |
| 88365 | 6086 destination |
| 6087 = (unsigned char *) xrealloc (destination, coding->produced); | |
| 6088 if (! destination) | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6089 { |
| 88365 | 6090 coding->result = CODING_RESULT_INSUFFICIENT_DST; |
| 6091 unbind_to (count, Qnil); | |
| 6092 return; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6093 } |
| 88365 | 6094 if (BEGV < GPT && GPT < BEGV + coding->produced_char) |
| 6095 move_gap_both (BEGV, BEGV_BYTE); | |
| 6096 bcopy (BEGV_ADDR, destination, coding->produced); | |
| 6097 coding->destination = destination; | |
|
23279
ca159e828a68
(ccl_coding_driver): If ccl_driver is interrupted by a
Kenichi Handa <handa@m17n.org>
parents:
23258
diff
changeset
|
6098 } |
| 88365 | 6099 } |
| 6100 | |
| 6101 unbind_to (count, Qnil); | |
| 6102 } | |
| 6103 | |
| 6104 | |
| 6105 void | |
| 6106 encode_coding_object (coding, src_object, from, from_byte, to, to_byte, | |
| 6107 dst_object) | |
| 6108 struct coding_system *coding; | |
| 6109 Lisp_Object src_object; | |
| 6110 EMACS_INT from, from_byte, to, to_byte; | |
| 6111 Lisp_Object dst_object; | |
| 6112 { | |
| 6113 int count = specpdl_ptr - specpdl; | |
| 6114 EMACS_INT chars = to - from; | |
| 6115 EMACS_INT bytes = to_byte - from_byte; | |
| 6116 Lisp_Object attrs; | |
| 6117 | |
| 6118 saved_coding = coding; | |
| 6119 record_unwind_protect (code_conversion_restore, save_excursion_save ()); | |
| 6120 | |
| 6121 coding->src_object = src_object; | |
| 6122 coding->src_chars = chars; | |
| 6123 coding->src_bytes = bytes; | |
| 6124 coding->src_multibyte = chars < bytes; | |
| 6125 | |
| 6126 attrs = CODING_ID_ATTRS (coding->id); | |
| 6127 | |
| 6128 if (! NILP (CODING_ATTR_PRE_WRITE (attrs))) | |
|
21062
839b22ad1e42
(code_convert_region): Handle the case that codes
Kenichi Handa <handa@m17n.org>
parents:
20999
diff
changeset
|
6129 { |
| 88365 | 6130 coding->src_object = make_conversion_work_buffer (coding->src_multibyte); |
| 6131 set_buffer_internal (XBUFFER (coding->src_object)); | |
| 6132 if (STRINGP (src_object)) | |
| 6133 insert_from_string (src_object, from, from_byte, chars, bytes, 0); | |
| 6134 else if (BUFFERP (src_object)) | |
| 6135 insert_from_buffer (XBUFFER (src_object), from, chars, 0); | |
| 6136 else | |
| 6137 insert_1_both (coding->source + from, chars, bytes, 0, 0, 0); | |
| 6138 | |
| 6139 if (EQ (src_object, dst_object)) | |
| 6140 { | |
| 6141 set_buffer_internal (XBUFFER (src_object)); | |
| 6142 del_range_both (from, from_byte, to, to_byte, 1); | |
| 6143 set_buffer_internal (XBUFFER (coding->src_object)); | |
| 6144 } | |
| 6145 | |
|
88510
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
6146 call2 (CODING_ATTR_PRE_WRITE (attrs), |
|
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
6147 make_number (BEG), make_number (Z)); |
|
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
6148 coding->src_object = Fcurrent_buffer (); |
| 88365 | 6149 if (BEG != GPT) |
| 6150 move_gap_both (BEG, BEG_BYTE); | |
| 6151 coding->src_chars = Z - BEG; | |
| 6152 coding->src_bytes = Z_BYTE - BEG_BYTE; | |
| 6153 coding->src_pos = BEG; | |
| 6154 coding->src_pos_byte = BEG_BYTE; | |
| 6155 coding->src_multibyte = Z < Z_BYTE; | |
| 6156 } | |
| 6157 else if (STRINGP (src_object)) | |
| 6158 { | |
| 6159 coding->src_pos = from; | |
| 6160 coding->src_pos_byte = from_byte; | |
| 6161 } | |
| 6162 else if (BUFFERP (src_object)) | |
| 6163 { | |
| 6164 set_buffer_internal (XBUFFER (src_object)); | |
| 6165 if (from != GPT) | |
| 6166 move_gap_both (from, from_byte); | |
| 6167 if (EQ (src_object, dst_object)) | |
| 6168 { | |
| 6169 del_range_both (from, from_byte, to, to_byte, 1); | |
| 6170 coding->src_pos = -chars; | |
| 6171 coding->src_pos_byte = -bytes; | |
| 6172 } | |
|
23514
7bad909cd6f1
(setup_coding_system): Fix setting up
Kenichi Handa <handa@m17n.org>
parents:
23475
diff
changeset
|
6173 else |
| 88365 | 6174 { |
| 6175 coding->src_pos = from; | |
| 6176 coding->src_pos_byte = from_byte; | |
| 6177 } | |
| 6178 } | |
| 6179 | |
| 6180 if (BUFFERP (dst_object)) | |
| 6181 { | |
| 6182 coding->dst_object = dst_object; | |
|
89042
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6183 if (EQ (src_object, dst_object)) |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6184 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6185 coding->dst_pos = from; |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6186 coding->dst_pos_byte = from_byte; |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6187 } |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6188 else |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6189 { |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6190 coding->dst_pos = BUF_PT (XBUFFER (dst_object)); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6191 coding->dst_pos_byte = BUF_PT_BYTE (XBUFFER (dst_object)); |
|
2b9f8973f240
(coding_set_destination): Fix coding->destination for
Kenichi Handa <handa@m17n.org>
parents:
88977
diff
changeset
|
6192 } |
| 88365 | 6193 coding->dst_multibyte |
| 6194 = ! NILP (XBUFFER (dst_object)->enable_multibyte_characters); | |
| 6195 } | |
| 6196 else if (EQ (dst_object, Qt)) | |
| 6197 { | |
| 6198 coding->dst_object = Qnil; | |
| 6199 coding->dst_bytes = coding->src_chars; | |
|
88510
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
6200 if (coding->dst_bytes == 0) |
|
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
6201 coding->dst_bytes = 1; |
|
d266b8fb8761
(encode_coding_object): Give correct arguments ot
Kenichi Handa <handa@m17n.org>
parents:
88506
diff
changeset
|
6202 coding->destination = (unsigned char *) xmalloc (coding->dst_bytes); |
| 88365 | 6203 coding->dst_multibyte = 0; |
| 6204 } | |
| 6205 else | |
| 6206 { | |
| 6207 coding->dst_object = Qnil; | |
| 6208 coding->dst_multibyte = 0; | |
| 6209 } | |
| 6210 | |
| 6211 encode_coding (coding); | |
| 6212 | |
| 6213 if (EQ (dst_object, Qt)) | |
| 6214 { | |
| 6215 if (BUFFERP (coding->dst_object)) | |
| 6216 coding->dst_object = Fbuffer_string (); | |
| 6217 else | |
| 6218 { | |
| 6219 coding->dst_object | |
| 6220 = make_unibyte_string ((char *) coding->destination, | |
| 6221 coding->produced); | |
| 6222 xfree (coding->destination); | |
| 6223 } | |
| 6224 } | |
| 6225 | |
| 6226 unbind_to (count, Qnil); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6227 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6228 |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
6229 |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
6230 Lisp_Object |
| 88365 | 6231 preferred_coding_system () |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6232 { |
| 88365 | 6233 int id = coding_categories[coding_priorities[0]].id; |
| 6234 | |
| 6235 return CODING_ID_NAME (id); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6236 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6237 |
| 17052 | 6238 |
| 6239 #ifdef emacs | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
6240 /*** 8. Emacs Lisp library functions ***/ |
| 17052 | 6241 |
| 6242 DEFUN ("coding-system-p", Fcoding_system_p, Scoding_system_p, 1, 1, 0, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6243 doc: /* Return t if OBJECT is nil or a coding-system. |
| 88365 | 6244 See the documentation of `define-coding-system' for information |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6245 about coding-system objects. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6246 (obj) |
| 17052 | 6247 Lisp_Object obj; |
| 6248 { | |
| 88365 | 6249 return ((NILP (obj) || CODING_SYSTEM_P (obj)) ? Qt : Qnil); |
| 17052 | 6250 } |
| 6251 | |
|
17717
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
6252 DEFUN ("read-non-nil-coding-system", Fread_non_nil_coding_system, |
|
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
6253 Sread_non_nil_coding_system, 1, 1, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6254 doc: /* Read a coding system from the minibuffer, prompting with string PROMPT. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6255 (prompt) |
| 17052 | 6256 Lisp_Object prompt; |
| 6257 { | |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
6258 Lisp_Object val; |
|
17717
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
6259 do |
|
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
6260 { |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
6261 val = Fcompleting_read (prompt, Vcoding_system_alist, Qnil, |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
6262 Qt, Qnil, Qcoding_system_history, Qnil, Qnil); |
|
17717
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
6263 } |
|
4891aaecc5cc
(Fread_coding_system, Fread_non_nil_coding_system):
Richard M. Stallman <rms@gnu.org>
parents:
17485
diff
changeset
|
6264 while (XSTRING (val)->size == 0); |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
6265 return (Fintern (val, Qnil)); |
| 17052 | 6266 } |
| 6267 | |
|
19758
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
6268 DEFUN ("read-coding-system", Fread_coding_system, Sread_coding_system, 1, 2, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6269 doc: /* Read a coding system from the minibuffer, prompting with string PROMPT. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6270 If the user enters null input, return second argument DEFAULT-CODING-SYSTEM. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6271 (prompt, default_coding_system) |
|
19758
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
6272 Lisp_Object prompt, default_coding_system; |
| 17052 | 6273 { |
|
19747
bed06df9cbc5
(setup_coding_system, Ffind_operation_coding_system)
Richard M. Stallman <rms@gnu.org>
parents:
19743
diff
changeset
|
6274 Lisp_Object val; |
|
19758
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
6275 if (SYMBOLP (default_coding_system)) |
|
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
6276 XSETSTRING (default_coding_system, XSYMBOL (default_coding_system)->name); |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
6277 val = Fcompleting_read (prompt, Vcoding_system_alist, Qnil, |
|
19758
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
6278 Qt, Qnil, Qcoding_system_history, |
|
49a1662b68dd
(Fread_coding_system): New optional arg DEFAULT_CODING_SYSTEM.
Richard M. Stallman <rms@gnu.org>
parents:
19750
diff
changeset
|
6279 default_coding_system, Qnil); |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
6280 return (XSTRING (val)->size == 0 ? Qnil : Fintern (val, Qnil)); |
| 17052 | 6281 } |
| 6282 | |
| 6283 DEFUN ("check-coding-system", Fcheck_coding_system, Scheck_coding_system, | |
| 6284 1, 1, 0, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6285 doc: /* Check validity of CODING-SYSTEM. |
| 89218 | 6286 If valid, return CODING-SYSTEM, else signal a `coding-system-error' error. */) |
| 88365 | 6287 (coding_system) |
| 17052 | 6288 Lisp_Object coding_system; |
| 6289 { | |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
6290 CHECK_SYMBOL (coding_system); |
| 17052 | 6291 if (!NILP (Fcoding_system_p (coding_system))) |
| 6292 return coding_system; | |
| 6293 while (1) | |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
6294 Fsignal (Qcoding_system_error, Fcons (coding_system, Qnil)); |
| 17052 | 6295 } |
| 88365 | 6296 |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
6297 |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6298 /* Detect how the bytes at SRC of length SRC_BYTES are encoded. If |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6299 HIGHEST is nonzero, return the coding system of the highest |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6300 priority among the detected coding systems. Otherwize return a |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6301 list of detected coding systems sorted by their priorities. If |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6302 MULTIBYTEP is nonzero, it is assumed that the bytes are in correct |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6303 multibyte form but contains only ASCII and eight-bit chars. |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6304 Otherwise, the bytes are raw bytes. |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6305 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6306 CODING-SYSTEM controls the detection as below: |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6307 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6308 If it is nil, detect both text-format and eol-format. If the |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6309 text-format part of CODING-SYSTEM is already specified |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6310 (e.g. `iso-latin-1'), detect only eol-format. If the eol-format |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6311 part of CODING-SYSTEM is already specified (e.g. `undecided-unix'), |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6312 detect only text-format. */ |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6313 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6314 Lisp_Object |
| 88365 | 6315 detect_coding_system (src, src_bytes, highest, multibytep, coding_system) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6316 unsigned char *src; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6317 int src_bytes, highest; |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
6318 int multibytep; |
| 88365 | 6319 Lisp_Object coding_system; |
| 17052 | 6320 { |
| 88365 | 6321 unsigned char *src_end = src + src_bytes; |
| 6322 int mask = CATEGORY_MASK_ANY; | |
| 6323 int detected = 0; | |
| 6324 int c, i; | |
| 6325 Lisp_Object attrs, eol_type; | |
| 6326 Lisp_Object val; | |
| 6327 struct coding_system coding; | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6328 int id; |
| 88365 | 6329 |
| 6330 if (NILP (coding_system)) | |
| 6331 coding_system = Qundecided; | |
| 6332 setup_coding_system (coding_system, &coding); | |
| 6333 attrs = CODING_ID_ATTRS (coding.id); | |
| 6334 eol_type = CODING_ID_EOL_TYPE (coding.id); | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6335 coding_system = CODING_ATTR_BASE_NAME (attrs); |
| 88365 | 6336 |
| 6337 coding.source = src; | |
| 6338 coding.src_bytes = src_bytes; | |
| 6339 coding.src_multibyte = multibytep; | |
| 6340 coding.consumed = 0; | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6341 coding.mode |= CODING_MODE_LAST_BLOCK; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6342 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6343 /* At first, detect text-format if necessary. */ |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6344 if (XINT (CODING_ATTR_CATEGORY (attrs)) == coding_category_undecided) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6345 { |
| 88365 | 6346 for (; src < src_end; src++) |
| 17052 | 6347 { |
| 88365 | 6348 c = *src; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6349 if (c & 0x80 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6350 || (c < 0x20 && (c == ISO_CODE_ESC |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6351 || c == ISO_CODE_SI |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
6352 || c == ISO_CODE_SO))) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6353 break; |
| 17052 | 6354 } |
| 88365 | 6355 coding.head_ascii = src - coding.source; |
| 6356 | |
| 6357 if (src < src_end) | |
| 6358 for (i = 0; i < coding_category_raw_text; i++) | |
| 6359 { | |
| 6360 enum coding_category category = coding_priorities[i]; | |
| 6361 struct coding_system *this = coding_categories + category; | |
| 6362 | |
| 6363 if (this->id < 0) | |
| 6364 { | |
| 6365 /* No coding system of this category is defined. */ | |
| 6366 mask &= ~(1 << category); | |
| 6367 } | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6368 else if (category >= coding_category_raw_text |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6369 || detected & (1 << category)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6370 continue; |
| 88365 | 6371 else |
| 6372 { | |
| 6373 detected |= detected_mask[category]; | |
| 6374 if ((*(coding_categories[category].detector)) (&coding, &mask) | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6375 && highest |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6376 && (mask & (1 << category))) |
| 88365 | 6377 { |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6378 mask = 1 << category; |
| 88365 | 6379 break; |
| 6380 } | |
| 6381 } | |
| 6382 } | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6383 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6384 if (!mask) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6385 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6386 id = coding_categories[coding_category_raw_text].id; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6387 val = Fcons (make_number (id), Qnil); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6388 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6389 else if (mask == CATEGORY_MASK_ANY) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6390 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6391 id = coding_categories[coding_category_undecided].id; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6392 val = Fcons (make_number (id), Qnil); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6393 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6394 else if (highest) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6395 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6396 for (i = 0; i < coding_category_raw_text; i++) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6397 if (mask & (1 << coding_priorities[i])) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6398 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6399 id = coding_categories[coding_priorities[i]].id; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6400 val = Fcons (make_number (id), Qnil); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6401 break; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6402 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6403 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6404 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6405 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6406 val = Qnil; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6407 for (i = coding_category_raw_text - 1; i >= 0; i--) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6408 if (mask & (1 << coding_priorities[i])) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6409 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6410 id = coding_categories[coding_priorities[i]].id; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6411 val = Fcons (make_number (id), val); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6412 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6413 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6414 } |
| 88365 | 6415 else |
| 6416 { | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6417 mask = 1 << XINT (CODING_ATTR_CATEGORY (attrs)); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6418 val = Fcons (make_number (coding.id), Qnil); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6419 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6420 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6421 /* Then, detect eol-format if necessary. */ |
| 88365 | 6422 { |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6423 int normal_eol = -1, utf_16_be_eol = -1, utf_16_le_eol; |
| 88365 | 6424 Lisp_Object tail; |
| 6425 | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6426 if (VECTORP (eol_type)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6427 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6428 if (mask & ~CATEGORY_MASK_UTF_16) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6429 normal_eol = detect_eol (coding.source, src_bytes, |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6430 coding_category_raw_text); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6431 if (mask & (CATEGORY_MASK_UTF_16_BE | CATEGORY_MASK_UTF_16_BE_NOSIG)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6432 utf_16_be_eol = detect_eol (coding.source, src_bytes, |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6433 coding_category_utf_16_be); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6434 if (mask & (CATEGORY_MASK_UTF_16_LE | CATEGORY_MASK_UTF_16_LE_NOSIG)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6435 utf_16_le_eol = detect_eol (coding.source, src_bytes, |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6436 coding_category_utf_16_le); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6437 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6438 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6439 { |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6440 if (EQ (eol_type, Qunix)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6441 normal_eol = utf_16_be_eol = utf_16_le_eol = EOL_SEEN_LF; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6442 else if (EQ (eol_type, Qdos)) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6443 normal_eol = utf_16_be_eol = utf_16_le_eol = EOL_SEEN_CRLF; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6444 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6445 normal_eol = utf_16_be_eol = utf_16_le_eol = EOL_SEEN_CR; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6446 } |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6447 |
| 88365 | 6448 for (tail = val; CONSP (tail); tail = XCDR (tail)) |
| 6449 { | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6450 enum coding_category category; |
| 88365 | 6451 int this_eol; |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6452 |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6453 id = XINT (XCAR (tail)); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6454 attrs = CODING_ID_ATTRS (id); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6455 category = XINT (CODING_ATTR_CATEGORY (attrs)); |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6456 eol_type = CODING_ID_EOL_TYPE (id); |
| 88365 | 6457 if (VECTORP (eol_type)) |
| 6458 { | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6459 if (category == coding_category_utf_16_be |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6460 || category == coding_category_utf_16_be_nosig) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6461 this_eol = utf_16_be_eol; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6462 else if (category == coding_category_utf_16_le |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6463 || category == coding_category_utf_16_le_nosig) |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6464 this_eol = utf_16_le_eol; |
| 88365 | 6465 else |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6466 this_eol = normal_eol; |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6467 |
| 88365 | 6468 if (this_eol == EOL_SEEN_LF) |
| 6469 XSETCAR (tail, AREF (eol_type, 0)); | |
| 6470 else if (this_eol == EOL_SEEN_CRLF) | |
| 6471 XSETCAR (tail, AREF (eol_type, 1)); | |
| 6472 else if (this_eol == EOL_SEEN_CR) | |
| 6473 XSETCAR (tail, AREF (eol_type, 2)); | |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6474 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6475 XSETCAR (tail, CODING_ID_NAME (id)); |
| 88365 | 6476 } |
|
89193
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6477 else |
|
311d061195ef
(detect_coding_utf_8): Check incomplete byte sequence.
Kenichi Handa <handa@m17n.org>
parents:
89184
diff
changeset
|
6478 XSETCAR (tail, CODING_ID_NAME (id)); |
| 88365 | 6479 } |
| 6480 } | |
| 6481 | |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
6482 return (highest ? XCAR (val) : val); |
|
42104
d69c2368e549
(DECODE_COMPOSITION_END): Fixed a typo in the last
Sam Steingold <sds@gnu.org>
parents:
42103
diff
changeset
|
6483 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6484 |
| 88365 | 6485 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6486 DEFUN ("detect-coding-region", Fdetect_coding_region, Sdetect_coding_region, |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6487 2, 3, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6488 doc: /* Detect coding system of the text in the region between START and END. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6489 Return a list of possible coding systems ordered by priority. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6490 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6491 If only ASCII characters are found, it returns a list of single element |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6492 `undecided' or its subsidiary coding system according to a detected |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6493 end-of-line format. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6494 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6495 If optional argument HIGHEST is non-nil, return the coding system of |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6496 highest priority. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6497 (start, end, highest) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6498 Lisp_Object start, end, highest; |
| 17052 | 6499 { |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6500 int from, to; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6501 int from_byte, to_byte; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6502 |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
6503 CHECK_NUMBER_COERCE_MARKER (start); |
|
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
6504 CHECK_NUMBER_COERCE_MARKER (end); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6505 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6506 validate_region (&start, &end); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6507 from = XINT (start), to = XINT (end); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6508 from_byte = CHAR_TO_BYTE (from); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6509 to_byte = CHAR_TO_BYTE (to); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6510 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6511 if (from < GPT && to >= GPT) |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6512 move_gap_both (to, to_byte); |
| 88365 | 6513 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6514 return detect_coding_system (BYTE_POS_ADDR (from_byte), |
| 88365 | 6515 to_byte - from_byte, |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
6516 !NILP (highest), |
|
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
6517 !NILP (current_buffer |
| 88365 | 6518 ->enable_multibyte_characters), |
| 6519 Qnil); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6520 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6521 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6522 DEFUN ("detect-coding-string", Fdetect_coding_string, Sdetect_coding_string, |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6523 1, 2, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6524 doc: /* Detect coding system of the text in STRING. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6525 Return a list of possible coding systems ordered by priority. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6526 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6527 If only ASCII characters are found, it returns a list of single element |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6528 `undecided' or its subsidiary coding system according to a detected |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6529 end-of-line format. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6530 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6531 If optional argument HIGHEST is non-nil, return the coding system of |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6532 highest priority. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6533 (string, highest) |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6534 Lisp_Object string, highest; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6535 { |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
6536 CHECK_STRING (string); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6537 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6538 return detect_coding_system (XSTRING (string)->data, |
| 88365 | 6539 STRING_BYTES (XSTRING (string)), |
|
34531
37f85e931855
(ONE_MORE_BYTE_CHECK_MULTIBYTE): New macro.
Kenichi Handa <handa@m17n.org>
parents:
34197
diff
changeset
|
6540 !NILP (highest), |
| 88365 | 6541 STRING_MULTIBYTE (string), |
| 6542 Qnil); | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6543 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6544 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6545 |
| 88365 | 6546 static INLINE int |
| 6547 char_encodable_p (c, attrs) | |
| 6548 int c; | |
| 6549 Lisp_Object attrs; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6550 { |
| 88365 | 6551 Lisp_Object tail; |
| 6552 struct charset *charset; | |
| 6553 | |
| 6554 for (tail = CODING_ATTR_CHARSET_LIST (attrs); | |
| 6555 CONSP (tail); tail = XCDR (tail)) | |
| 6556 { | |
| 6557 charset = CHARSET_FROM_ID (XINT (XCAR (tail))); | |
| 6558 if (CHAR_CHARSET_P (c, charset)) | |
| 6559 break; | |
| 6560 } | |
| 6561 return (! NILP (tail)); | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6562 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6563 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6564 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6565 /* Return a list of coding systems that safely encode the text between |
| 88365 | 6566 START and END. If EXCLUDE is non-nil, it is a list of coding |
| 6567 systems not to check. The returned list doesn't contain any such | |
|
88889
4548f224c603
(Ffind_coding_systems_region_internal): Detect an
Kenichi Handa <handa@m17n.org>
parents:
88876
diff
changeset
|
6568 coding systems. In any case, if the text contains only ASCII or is |
| 88365 | 6569 unibyte, return t. */ |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6570 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6571 DEFUN ("find-coding-systems-region-internal", |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6572 Ffind_coding_systems_region_internal, |
| 88365 | 6573 Sfind_coding_systems_region_internal, 2, 3, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6574 doc: /* Internal use only. */) |
| 88365 | 6575 (start, end, exclude) |
| 6576 Lisp_Object start, end, exclude; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6577 { |
| 88365 | 6578 Lisp_Object coding_attrs_list, safe_codings; |
| 6579 EMACS_INT start_byte, end_byte; | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
6580 const unsigned char *p, *pbeg, *pend; |
| 88365 | 6581 int c; |
| 6582 Lisp_Object tail, elt; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6583 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6584 if (STRINGP (start)) |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6585 { |
| 88365 | 6586 if (!STRING_MULTIBYTE (start) |
|
88889
4548f224c603
(Ffind_coding_systems_region_internal): Detect an
Kenichi Handa <handa@m17n.org>
parents:
88876
diff
changeset
|
6587 || XSTRING (start)->size == STRING_BYTES (XSTRING (start))) |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6588 return Qt; |
| 88365 | 6589 start_byte = 0; |
| 6590 end_byte = STRING_BYTES (XSTRING (start)); | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6591 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6592 else |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6593 { |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
6594 CHECK_NUMBER_COERCE_MARKER (start); |
|
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
6595 CHECK_NUMBER_COERCE_MARKER (end); |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6596 if (XINT (start) < BEG || XINT (end) > Z || XINT (start) > XINT (end)) |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6597 args_out_of_range (start, end); |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6598 if (NILP (current_buffer->enable_multibyte_characters)) |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6599 return Qt; |
| 88365 | 6600 start_byte = CHAR_TO_BYTE (XINT (start)); |
| 6601 end_byte = CHAR_TO_BYTE (XINT (end)); | |
| 6602 if (XINT (end) - XINT (start) == end_byte - start_byte) | |
| 6603 return Qt; | |
| 6604 | |
| 6605 if (start < GPT && end > GPT) | |
| 6606 { | |
| 6607 if ((GPT - start) < (end - GPT)) | |
| 6608 move_gap_both (start, start_byte); | |
| 6609 else | |
| 6610 move_gap_both (end, end_byte); | |
| 6611 } | |
| 6612 } | |
| 6613 | |
| 6614 coding_attrs_list = Qnil; | |
| 6615 for (tail = Vcoding_system_list; CONSP (tail); tail = XCDR (tail)) | |
| 6616 if (NILP (exclude) | |
| 6617 || NILP (Fmemq (XCAR (tail), exclude))) | |
| 6618 { | |
| 6619 Lisp_Object attrs; | |
| 6620 | |
| 6621 attrs = AREF (CODING_SYSTEM_SPEC (XCAR (tail)), 0); | |
| 6622 if (EQ (XCAR (tail), CODING_ATTR_BASE_NAME (attrs)) | |
| 6623 && ! EQ (CODING_ATTR_TYPE (attrs), Qundecided)) | |
| 6624 coding_attrs_list = Fcons (attrs, coding_attrs_list); | |
| 6625 } | |
| 6626 | |
| 6627 if (STRINGP (start)) | |
| 6628 p = pbeg = XSTRING (start)->data; | |
| 6629 else | |
| 6630 p = pbeg = BYTE_POS_ADDR (start_byte); | |
| 6631 pend = p + (end_byte - start_byte); | |
| 6632 | |
| 6633 while (p < pend && ASCII_BYTE_P (*p)) p++; | |
| 6634 while (p < pend && ASCII_BYTE_P (*(pend - 1))) pend--; | |
| 6635 | |
| 6636 while (p < pend) | |
| 6637 { | |
| 6638 if (ASCII_BYTE_P (*p)) | |
| 6639 p++; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6640 else |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6641 { |
| 88365 | 6642 c = STRING_CHAR_ADVANCE (p); |
| 6643 | |
| 6644 charset_map_loaded = 0; | |
| 6645 for (tail = coding_attrs_list; CONSP (tail);) | |
| 6646 { | |
| 6647 elt = XCAR (tail); | |
| 6648 if (NILP (elt)) | |
| 6649 tail = XCDR (tail); | |
| 6650 else if (char_encodable_p (c, elt)) | |
| 6651 tail = XCDR (tail); | |
| 6652 else if (CONSP (XCDR (tail))) | |
| 6653 { | |
| 6654 XSETCAR (tail, XCAR (XCDR (tail))); | |
| 6655 XSETCDR (tail, XCDR (XCDR (tail))); | |
| 6656 } | |
| 6657 else | |
| 6658 { | |
| 6659 XSETCAR (tail, Qnil); | |
| 6660 tail = XCDR (tail); | |
| 6661 } | |
| 6662 } | |
| 6663 if (charset_map_loaded) | |
| 6664 { | |
| 6665 EMACS_INT p_offset = p - pbeg, pend_offset = pend - pbeg; | |
| 6666 | |
| 6667 if (STRINGP (start)) | |
| 6668 pbeg = XSTRING (start)->data; | |
| 6669 else | |
| 6670 pbeg = BYTE_POS_ADDR (start_byte); | |
| 6671 p = pbeg + p_offset; | |
| 6672 pend = pbeg + pend_offset; | |
| 6673 } | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6674 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6675 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6676 |
| 88365 | 6677 safe_codings = Qnil; |
| 6678 for (tail = coding_attrs_list; CONSP (tail); tail = XCDR (tail)) | |
| 6679 if (! NILP (XCAR (tail))) | |
| 6680 safe_codings = Fcons (CODING_ATTR_BASE_NAME (XCAR (tail)), safe_codings); | |
| 6681 | |
| 6682 return safe_codings; | |
| 6683 } | |
| 6684 | |
| 6685 | |
| 6686 DEFUN ("check-coding-systems-region", Fcheck_coding_systems_region, | |
| 6687 Scheck_coding_systems_region, 3, 3, 0, | |
| 6688 doc: /* Check if the region is encodable by coding systems. | |
| 6689 | |
| 6690 START and END are buffer positions specifying the region. | |
| 6691 CODING-SYSTEM-LIST is a list of coding systems to check. | |
| 6692 | |
| 6693 The value is an alist ((CODING-SYSTEM POS0 POS1 ...) ...), where | |
| 6694 CODING-SYSTEM is a member of CODING-SYSTEM-LIst and can't encode the | |
| 6695 whole region, POS0, POS1, ... are buffer positions where non-encodable | |
| 6696 characters are found. | |
| 6697 | |
| 6698 If all coding systems in CODING-SYSTEM-LIST can encode the region, the | |
| 6699 value is nil. | |
| 6700 | |
| 6701 START may be a string. In that case, check if the string is | |
| 6702 encodable, and the value contains indices to the string instead of | |
| 6703 buffer positions. END is ignored. */) | |
| 6704 (start, end, coding_system_list) | |
| 6705 Lisp_Object start, end, coding_system_list; | |
| 6706 { | |
| 6707 Lisp_Object list; | |
| 6708 EMACS_INT start_byte, end_byte; | |
| 6709 int pos; | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
6710 const unsigned char *p, *pbeg, *pend; |
| 88365 | 6711 int c; |
| 6712 Lisp_Object tail, elt; | |
| 6713 | |
| 6714 if (STRINGP (start)) | |
| 6715 { | |
| 6716 if (!STRING_MULTIBYTE (start) | |
| 6717 && XSTRING (start)->size != STRING_BYTES (XSTRING (start))) | |
| 6718 return Qnil; | |
| 6719 start_byte = 0; | |
| 6720 end_byte = STRING_BYTES (XSTRING (start)); | |
| 6721 pos = 0; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6722 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6723 else |
| 88365 | 6724 { |
| 6725 CHECK_NUMBER_COERCE_MARKER (start); | |
| 6726 CHECK_NUMBER_COERCE_MARKER (end); | |
| 6727 if (XINT (start) < BEG || XINT (end) > Z || XINT (start) > XINT (end)) | |
| 6728 args_out_of_range (start, end); | |
| 6729 if (NILP (current_buffer->enable_multibyte_characters)) | |
| 6730 return Qnil; | |
| 6731 start_byte = CHAR_TO_BYTE (XINT (start)); | |
| 6732 end_byte = CHAR_TO_BYTE (XINT (end)); | |
| 6733 if (XINT (end) - XINT (start) == end_byte - start_byte) | |
| 6734 return Qt; | |
| 6735 | |
| 6736 if (start < GPT && end > GPT) | |
| 6737 { | |
| 6738 if ((GPT - start) < (end - GPT)) | |
| 6739 move_gap_both (start, start_byte); | |
| 6740 else | |
| 6741 move_gap_both (end, end_byte); | |
| 6742 } | |
| 6743 pos = start; | |
| 6744 } | |
| 6745 | |
| 6746 list = Qnil; | |
| 6747 for (tail = coding_system_list; CONSP (tail); tail = XCDR (tail)) | |
| 6748 { | |
| 6749 elt = XCAR (tail); | |
| 6750 list = Fcons (Fcons (elt, Fcons (AREF (CODING_SYSTEM_SPEC (elt), 0), | |
| 6751 Qnil)), | |
| 6752 list); | |
| 6753 } | |
| 6754 | |
| 6755 if (STRINGP (start)) | |
| 6756 p = pbeg = XSTRING (start)->data; | |
| 6757 else | |
| 6758 p = pbeg = BYTE_POS_ADDR (start_byte); | |
| 6759 pend = p + (end_byte - start_byte); | |
| 6760 | |
| 6761 while (p < pend && ASCII_BYTE_P (*p)) p++, pos++; | |
| 6762 while (p < pend && ASCII_BYTE_P (*(pend - 1))) pend--; | |
| 6763 | |
| 6764 while (p < pend) | |
| 6765 { | |
| 6766 if (ASCII_BYTE_P (*p)) | |
| 6767 p++; | |
| 6768 else | |
| 6769 { | |
| 6770 c = STRING_CHAR_ADVANCE (p); | |
| 6771 | |
| 6772 charset_map_loaded = 0; | |
| 6773 for (tail = list; CONSP (tail); tail = XCDR (tail)) | |
| 6774 { | |
| 6775 elt = XCDR (XCAR (tail)); | |
| 6776 if (! char_encodable_p (c, XCAR (elt))) | |
| 6777 XSETCDR (elt, Fcons (make_number (pos), XCDR (elt))); | |
| 6778 } | |
| 6779 if (charset_map_loaded) | |
| 6780 { | |
| 6781 EMACS_INT p_offset = p - pbeg, pend_offset = pend - pbeg; | |
| 6782 | |
| 6783 if (STRINGP (start)) | |
| 6784 pbeg = XSTRING (start)->data; | |
| 6785 else | |
| 6786 pbeg = BYTE_POS_ADDR (start_byte); | |
| 6787 p = pbeg + p_offset; | |
| 6788 pend = pbeg + pend_offset; | |
| 6789 } | |
| 6790 } | |
| 6791 pos++; | |
| 6792 } | |
| 6793 | |
| 6794 tail = list; | |
| 6795 list = Qnil; | |
| 6796 for (; CONSP (tail); tail = XCDR (tail)) | |
| 6797 { | |
| 6798 elt = XCAR (tail); | |
| 6799 if (CONSP (XCDR (XCDR (elt)))) | |
| 6800 list = Fcons (Fcons (XCAR (elt), Fnreverse (XCDR (XCDR (elt)))), | |
| 6801 list); | |
| 6802 } | |
| 6803 | |
| 6804 return list; | |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6805 } |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6806 |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
6807 |
| 88365 | 6808 |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
6809 Lisp_Object |
| 88365 | 6810 code_convert_region (start, end, coding_system, dst_object, encodep, norecord) |
| 6811 Lisp_Object start, end, coding_system, dst_object; | |
| 6812 int encodep, norecord; | |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
6813 { |
|
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
6814 struct coding_system coding; |
| 88365 | 6815 EMACS_INT from, from_byte, to, to_byte; |
| 6816 Lisp_Object src_object; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6817 |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
6818 CHECK_NUMBER_COERCE_MARKER (start); |
|
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
6819 CHECK_NUMBER_COERCE_MARKER (end); |
| 88365 | 6820 if (NILP (coding_system)) |
| 6821 coding_system = Qno_conversion; | |
| 6822 else | |
| 6823 CHECK_CODING_SYSTEM (coding_system); | |
| 6824 src_object = Fcurrent_buffer (); | |
| 6825 if (NILP (dst_object)) | |
| 6826 dst_object = src_object; | |
| 6827 else if (! EQ (dst_object, Qt)) | |
| 6828 CHECK_BUFFER (dst_object); | |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
6829 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6830 validate_region (&start, &end); |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6831 from = XFASTINT (start); |
| 88365 | 6832 from_byte = CHAR_TO_BYTE (from); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6833 to = XFASTINT (end); |
| 88365 | 6834 to_byte = CHAR_TO_BYTE (to); |
| 6835 | |
| 6836 setup_coding_system (coding_system, &coding); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6837 coding.mode |= CODING_MODE_LAST_BLOCK; |
| 88365 | 6838 |
| 6839 if (encodep) | |
| 6840 encode_coding_object (&coding, src_object, from, from_byte, to, to_byte, | |
| 6841 dst_object); | |
| 6842 else | |
| 6843 decode_coding_object (&coding, src_object, from, from_byte, to, to_byte, | |
| 6844 dst_object); | |
| 6845 if (! norecord) | |
| 6846 Vlast_coding_system_used = CODING_ID_NAME (coding.id); | |
| 6847 | |
| 6848 if (coding.result != CODING_RESULT_SUCCESS) | |
| 6849 error ("Code conversion error: %d", coding.result); | |
| 6850 | |
| 6851 return (BUFFERP (dst_object) | |
| 6852 ? make_number (coding.produced_char) | |
| 6853 : coding.dst_object); | |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
6854 } |
|
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
6855 |
| 88365 | 6856 |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
6857 DEFUN ("decode-coding-region", Fdecode_coding_region, Sdecode_coding_region, |
| 88365 | 6858 3, 4, "r\nzCoding system: ", |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6859 doc: /* Decode the current region from the specified coding system. |
| 88365 | 6860 When called from a program, takes four arguments: |
| 6861 START, END, CODING-SYSTEM, and DESTINATION. | |
| 6862 START and END are buffer positions. | |
| 6863 | |
| 6864 Optional 4th arguments DESTINATION specifies where the decoded text goes. | |
| 6865 If nil, the region between START and END is replace by the decoded text. | |
| 6866 If buffer, the decoded text is inserted in the buffer. | |
| 6867 If t, the decoded text is returned. | |
| 6868 | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6869 This function sets `last-coding-system-used' to the precise coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6870 used (which may be different from CODING-SYSTEM if CODING-SYSTEM is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6871 not fully specified.) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6872 It returns the length of the decoded text. */) |
| 88365 | 6873 (start, end, coding_system, destination) |
| 6874 Lisp_Object start, end, coding_system, destination; | |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
6875 { |
| 88365 | 6876 return code_convert_region (start, end, coding_system, destination, 0, 0); |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
6877 } |
|
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
6878 |
|
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
6879 DEFUN ("encode-coding-region", Fencode_coding_region, Sencode_coding_region, |
| 88365 | 6880 3, 4, "r\nzCoding system: ", |
| 6881 doc: /* Encode the current region by specified coding system. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6882 When called from a program, takes three arguments: |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6883 START, END, and CODING-SYSTEM. START and END are buffer positions. |
| 88365 | 6884 |
| 6885 Optional 4th arguments DESTINATION specifies where the encoded text goes. | |
| 6886 If nil, the region between START and END is replace by the encoded text. | |
| 6887 If buffer, the encoded text is inserted in the buffer. | |
| 6888 If t, the encoded text is returned. | |
| 6889 | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6890 This function sets `last-coding-system-used' to the precise coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6891 used (which may be different from CODING-SYSTEM if CODING-SYSTEM is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6892 not fully specified.) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
6893 It returns the length of the encoded text. */) |
| 88365 | 6894 (start, end, coding_system, destination) |
| 6895 Lisp_Object start, end, coding_system, destination; | |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
6896 { |
| 88365 | 6897 return code_convert_region (start, end, coding_system, destination, 1, 0); |
| 17052 | 6898 } |
| 6899 | |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
6900 Lisp_Object |
| 88365 | 6901 code_convert_string (string, coding_system, dst_object, |
| 6902 encodep, nocopy, norecord) | |
| 6903 Lisp_Object string, coding_system, dst_object; | |
| 6904 int encodep, nocopy, norecord; | |
| 17052 | 6905 { |
| 6906 struct coding_system coding; | |
| 88365 | 6907 EMACS_INT chars, bytes; |
| 17052 | 6908 |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
6909 CHECK_STRING (string); |
| 88365 | 6910 if (NILP (coding_system)) |
| 6911 { | |
| 6912 if (! norecord) | |
| 6913 Vlast_coding_system_used = Qno_conversion; | |
| 6914 if (NILP (dst_object)) | |
| 6915 return (nocopy ? Fcopy_sequence (string) : string); | |
| 6916 } | |
| 17052 | 6917 |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
6918 if (NILP (coding_system)) |
| 88365 | 6919 coding_system = Qno_conversion; |
| 6920 else | |
| 6921 CHECK_CODING_SYSTEM (coding_system); | |
| 6922 if (NILP (dst_object)) | |
| 6923 dst_object = Qt; | |
| 6924 else if (! EQ (dst_object, Qt)) | |
| 6925 CHECK_BUFFER (dst_object); | |
| 6926 | |
| 6927 setup_coding_system (coding_system, &coding); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
6928 coding.mode |= CODING_MODE_LAST_BLOCK; |
| 88365 | 6929 chars = XSTRING (string)->size; |
| 6930 bytes = STRING_BYTES (XSTRING (string)); | |
| 6931 if (encodep) | |
| 6932 encode_coding_object (&coding, string, 0, 0, chars, bytes, dst_object); | |
| 6933 else | |
| 6934 decode_coding_object (&coding, string, 0, 0, chars, bytes, dst_object); | |
| 6935 if (! norecord) | |
| 6936 Vlast_coding_system_used = CODING_ID_NAME (coding.id); | |
| 6937 | |
| 6938 if (coding.result != CODING_RESULT_SUCCESS) | |
| 6939 error ("Code conversion error: %d", coding.result); | |
| 6940 | |
| 6941 return (BUFFERP (dst_object) | |
| 6942 ? make_number (coding.produced_char) | |
| 6943 : coding.dst_object); | |
|
20803
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
6944 } |
|
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
6945 |
|
0fa2183c587d
(ENCODE_ISO_CHARACTER): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
20794
diff
changeset
|
6946 |
|
22341
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
6947 /* Encode or decode STRING according to CODING_SYSTEM. |
| 26847 | 6948 Do not set Vlast_coding_system_used. |
| 6949 | |
| 6950 This function is called only from macros DECODE_FILE and | |
| 6951 ENCODE_FILE, thus we ignore character composition. */ | |
|
22341
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
6952 |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
6953 Lisp_Object |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
6954 code_convert_string_norecord (string, coding_system, encodep) |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
6955 Lisp_Object string, coding_system; |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
6956 int encodep; |
|
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
6957 { |
|
88430
6418a272b97e
* coding.c: Delete unused variables.
Kenichi Handa <handa@m17n.org>
parents:
88365
diff
changeset
|
6958 return code_convert_string (string, coding_system, Qt, encodep, 0, 1); |
|
22341
572ba933a4bf
(code_convert_string_norecord): New function.
Karl Heuer <kwzh@gnu.org>
parents:
22329
diff
changeset
|
6959 } |
| 88365 | 6960 |
| 6961 | |
| 6962 DEFUN ("decode-coding-string", Fdecode_coding_string, Sdecode_coding_string, | |
| 6963 2, 4, 0, | |
| 6964 doc: /* Decode STRING which is encoded in CODING-SYSTEM, and return the result. | |
| 6965 | |
| 6966 Optional third arg NOCOPY non-nil means it is OK to return STRING itself | |
| 6967 if the decoding operation is trivial. | |
| 6968 | |
| 6969 Optional fourth arg BUFFER non-nil meant that the decoded text is | |
|
88845
64b8f6168269
(Fset_coding_system_priority): Allow null arg list.
Dave Love <fx@gnu.org>
parents:
88771
diff
changeset
|
6970 inserted in BUFFER instead of returned as a string. In this case, |
| 88365 | 6971 the return value is BUFFER. |
| 6972 | |
| 6973 This function sets `last-coding-system-used' to the precise coding system | |
| 6974 used (which may be different from CODING-SYSTEM if CODING-SYSTEM is | |
| 6975 not fully specified. */) | |
| 6976 (string, coding_system, nocopy, buffer) | |
| 6977 Lisp_Object string, coding_system, nocopy, buffer; | |
| 6978 { | |
| 6979 return code_convert_string (string, coding_system, buffer, | |
| 6980 0, ! NILP (nocopy), 0); | |
| 6981 } | |
| 6982 | |
| 6983 DEFUN ("encode-coding-string", Fencode_coding_string, Sencode_coding_string, | |
| 6984 2, 4, 0, | |
| 6985 doc: /* Encode STRING to CODING-SYSTEM, and return the result. | |
| 6986 | |
| 6987 Optional third arg NOCOPY non-nil means it is OK to return STRING | |
| 6988 itself if the encoding operation is trivial. | |
| 6989 | |
| 6990 Optional fourth arg BUFFER non-nil meant that the encoded text is | |
|
88845
64b8f6168269
(Fset_coding_system_priority): Allow null arg list.
Dave Love <fx@gnu.org>
parents:
88771
diff
changeset
|
6991 inserted in BUFFER instead of returned as a string. In this case, |
| 88365 | 6992 the return value is BUFFER. |
| 6993 | |
| 6994 This function sets `last-coding-system-used' to the precise coding system | |
| 6995 used (which may be different from CODING-SYSTEM if CODING-SYSTEM is | |
| 6996 not fully specified.) */) | |
| 6997 (string, coding_system, nocopy, buffer) | |
| 6998 Lisp_Object string, coding_system, nocopy, buffer; | |
| 6999 { | |
| 7000 return code_convert_string (string, coding_system, buffer, | |
| 88856 | 7001 1, ! NILP (nocopy), 1); |
| 88365 | 7002 } |
| 7003 | |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
7004 |
| 17052 | 7005 DEFUN ("decode-sjis-char", Fdecode_sjis_char, Sdecode_sjis_char, 1, 1, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7006 doc: /* Decode a Japanese character which has CODE in shift_jis encoding. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7007 Return the corresponding character. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7008 (code) |
| 17052 | 7009 Lisp_Object code; |
| 7010 { | |
| 88365 | 7011 Lisp_Object spec, attrs, val; |
| 7012 struct charset *charset_roman, *charset_kanji, *charset_kana, *charset; | |
| 7013 int c; | |
| 7014 | |
| 7015 CHECK_NATNUM (code); | |
| 7016 c = XFASTINT (code); | |
| 7017 CHECK_CODING_SYSTEM_GET_SPEC (Vsjis_coding_system, spec); | |
| 7018 attrs = AREF (spec, 0); | |
| 7019 | |
| 7020 if (ASCII_BYTE_P (c) | |
| 7021 && ! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 7022 return code; | |
| 7023 | |
| 7024 val = CODING_ATTR_CHARSET_LIST (attrs); | |
| 7025 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
|
88497
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
7026 charset_kana = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); |
|
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
7027 charset_kanji = CHARSET_FROM_ID (XINT (XCAR (val))); |
| 88365 | 7028 |
| 7029 if (c <= 0x7F) | |
| 7030 charset = charset_roman; | |
| 7031 else if (c >= 0xA0 && c < 0xDF) | |
| 7032 { | |
| 7033 charset = charset_kana; | |
| 7034 c -= 0x80; | |
|
24065
7e291dea6141
(Fdecode_sjis_char): Decode Japanese Katakana character
Kenichi Handa <handa@m17n.org>
parents:
24056
diff
changeset
|
7035 } |
|
7e291dea6141
(Fdecode_sjis_char): Decode Japanese Katakana character
Kenichi Handa <handa@m17n.org>
parents:
24056
diff
changeset
|
7036 else |
|
7e291dea6141
(Fdecode_sjis_char): Decode Japanese Katakana character
Kenichi Handa <handa@m17n.org>
parents:
24056
diff
changeset
|
7037 { |
|
88497
d2b9e0d4c2f6
(Fdecode_sjis_char): Fix typo (0x7F->0xFF). Fix the
Kenichi Handa <handa@m17n.org>
parents:
88485
diff
changeset
|
7038 int s1 = c >> 8, s2 = c & 0xFF; |
| 88365 | 7039 |
| 7040 if (s1 < 0x81 || (s1 > 0x9F && s1 < 0xE0) || s1 > 0xEF | |
| 7041 || s2 < 0x40 || s2 == 0x7F || s2 > 0xFC) | |
| 7042 error ("Invalid code: %d", code); | |
| 7043 SJIS_TO_JIS (c); | |
| 7044 charset = charset_kanji; | |
| 7045 } | |
| 7046 c = DECODE_CHAR (charset, c); | |
| 7047 if (c < 0) | |
| 7048 error ("Invalid code: %d", code); | |
| 7049 return make_number (c); | |
| 17052 | 7050 } |
| 7051 | |
| 88365 | 7052 |
| 17052 | 7053 DEFUN ("encode-sjis-char", Fencode_sjis_char, Sencode_sjis_char, 1, 1, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7054 doc: /* Encode a Japanese character CHAR to shift_jis encoding. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7055 Return the corresponding code in SJIS. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7056 (ch) |
| 88365 | 7057 Lisp_Object ch; |
| 17052 | 7058 { |
| 88365 | 7059 Lisp_Object spec, attrs, charset_list; |
| 7060 int c; | |
| 7061 struct charset *charset; | |
| 7062 unsigned code; | |
| 7063 | |
| 7064 CHECK_CHARACTER (ch); | |
| 7065 c = XFASTINT (ch); | |
| 7066 CHECK_CODING_SYSTEM_GET_SPEC (Vsjis_coding_system, spec); | |
| 7067 attrs = AREF (spec, 0); | |
| 7068 | |
| 7069 if (ASCII_CHAR_P (c) | |
| 7070 && ! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 7071 return ch; | |
| 7072 | |
| 7073 charset_list = CODING_ATTR_CHARSET_LIST (attrs); | |
| 7074 charset = char_charset (c, charset_list, &code); | |
| 7075 if (code == CHARSET_INVALID_CODE (charset)) | |
| 7076 error ("Can't encode by shift_jis encoding: %d", c); | |
| 7077 JIS_TO_SJIS (code); | |
| 7078 | |
| 7079 return make_number (code); | |
| 17052 | 7080 } |
| 7081 | |
| 7082 DEFUN ("decode-big5-char", Fdecode_big5_char, Sdecode_big5_char, 1, 1, 0, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7083 doc: /* Decode a Big5 character which has CODE in BIG5 coding system. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7084 Return the corresponding character. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7085 (code) |
| 17052 | 7086 Lisp_Object code; |
| 7087 { | |
| 88365 | 7088 Lisp_Object spec, attrs, val; |
| 7089 struct charset *charset_roman, *charset_big5, *charset; | |
| 7090 int c; | |
| 7091 | |
| 7092 CHECK_NATNUM (code); | |
| 7093 c = XFASTINT (code); | |
| 7094 CHECK_CODING_SYSTEM_GET_SPEC (Vbig5_coding_system, spec); | |
| 7095 attrs = AREF (spec, 0); | |
| 7096 | |
| 7097 if (ASCII_BYTE_P (c) | |
| 7098 && ! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 7099 return code; | |
| 7100 | |
| 7101 val = CODING_ATTR_CHARSET_LIST (attrs); | |
| 7102 charset_roman = CHARSET_FROM_ID (XINT (XCAR (val))), val = XCDR (val); | |
| 7103 charset_big5 = CHARSET_FROM_ID (XINT (XCAR (val))); | |
| 7104 | |
| 7105 if (c <= 0x7F) | |
| 7106 charset = charset_roman; | |
|
24324
2eec590faf26
(Fdecode_sjis_char, Fencode_sjis_char): Hanlde
Kenichi Handa <handa@m17n.org>
parents:
24316
diff
changeset
|
7107 else |
|
2eec590faf26
(Fdecode_sjis_char, Fencode_sjis_char): Hanlde
Kenichi Handa <handa@m17n.org>
parents:
24316
diff
changeset
|
7108 { |
| 88365 | 7109 int b1 = c >> 8, b2 = c & 0x7F; |
| 7110 if (b1 < 0xA1 || b1 > 0xFE | |
| 7111 || b2 < 0x40 || (b2 > 0x7E && b2 < 0xA1) || b2 > 0xFE) | |
| 7112 error ("Invalid code: %d", code); | |
| 7113 charset = charset_big5; | |
| 7114 } | |
| 7115 c = DECODE_CHAR (charset, (unsigned )c); | |
| 7116 if (c < 0) | |
| 7117 error ("Invalid code: %d", code); | |
| 7118 return make_number (c); | |
| 17052 | 7119 } |
| 7120 | |
| 7121 DEFUN ("encode-big5-char", Fencode_big5_char, Sencode_big5_char, 1, 1, 0, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7122 doc: /* Encode the Big5 character CHAR to BIG5 coding system. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7123 Return the corresponding character code in Big5. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7124 (ch) |
| 17052 | 7125 Lisp_Object ch; |
| 7126 { | |
| 88365 | 7127 Lisp_Object spec, attrs, charset_list; |
| 7128 struct charset *charset; | |
| 7129 int c; | |
| 7130 unsigned code; | |
| 7131 | |
| 7132 CHECK_CHARACTER (ch); | |
| 7133 c = XFASTINT (ch); | |
| 7134 CHECK_CODING_SYSTEM_GET_SPEC (Vbig5_coding_system, spec); | |
| 7135 attrs = AREF (spec, 0); | |
| 7136 if (ASCII_CHAR_P (c) | |
| 7137 && ! NILP (CODING_ATTR_ASCII_COMPAT (attrs))) | |
| 7138 return ch; | |
| 7139 | |
| 7140 charset_list = CODING_ATTR_CHARSET_LIST (attrs); | |
| 7141 charset = char_charset (c, charset_list, &code); | |
| 7142 if (code == CHARSET_INVALID_CODE (charset)) | |
| 7143 error ("Can't encode by Big5 encoding: %d", c); | |
| 7144 | |
| 7145 return make_number (code); | |
| 17052 | 7146 } |
| 88365 | 7147 |
|
20680
dd46027e8412
(code_convert_region): Always count chars inserted
Richard M. Stallman <rms@gnu.org>
parents:
20668
diff
changeset
|
7148 |
|
18002
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
7149 DEFUN ("set-terminal-coding-system-internal", |
|
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
7150 Fset_terminal_coding_system_internal, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7151 Sset_terminal_coding_system_internal, 1, 1, 0, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7152 doc: /* Internal use only. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7153 (coding_system) |
| 88473 | 7154 Lisp_Object coding_system; |
| 17052 | 7155 { |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7156 CHECK_SYMBOL (coding_system); |
| 88365 | 7157 setup_coding_system (Fcheck_coding_system (coding_system), |
| 7158 &terminal_coding); | |
| 7159 | |
|
20150
402b6e5f4b58
(encode_designation_at_bol): Fix bug of finding graphic
Kenichi Handa <handa@m17n.org>
parents:
20105
diff
changeset
|
7160 /* We had better not send unsafe characters to terminal. */ |
| 88365 | 7161 terminal_coding.mode |= CODING_MODE_SAFE_ENCODING; |
| 7162 /* Characer composition should be disabled. */ | |
| 7163 terminal_coding.common_flags &= ~CODING_ANNOTATE_COMPOSITION_MASK; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
7164 terminal_coding.src_multibyte = 1; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
7165 terminal_coding.dst_multibyte = 0; |
| 17052 | 7166 return Qnil; |
| 7167 } | |
| 7168 | |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
7169 DEFUN ("set-safe-terminal-coding-system-internal", |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
7170 Fset_safe_terminal_coding_system_internal, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7171 Sset_safe_terminal_coding_system_internal, 1, 1, 0, |
| 41006 | 7172 doc: /* Internal use only. */) |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7173 (coding_system) |
| 88473 | 7174 Lisp_Object coding_system; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
7175 { |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7176 CHECK_SYMBOL (coding_system); |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
7177 setup_coding_system (Fcheck_coding_system (coding_system), |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
7178 &safe_terminal_coding); |
| 88365 | 7179 /* Characer composition should be disabled. */ |
| 7180 safe_terminal_coding.common_flags &= ~CODING_ANNOTATE_COMPOSITION_MASK; | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
7181 safe_terminal_coding.src_multibyte = 1; |
|
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
7182 safe_terminal_coding.dst_multibyte = 0; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
7183 return Qnil; |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
7184 } |
|
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
7185 |
| 17052 | 7186 DEFUN ("terminal-coding-system", |
| 7187 Fterminal_coding_system, Sterminal_coding_system, 0, 0, 0, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7188 doc: /* Return coding system specified for terminal output. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7189 () |
| 17052 | 7190 { |
| 88365 | 7191 return CODING_ID_NAME (terminal_coding.id); |
| 17052 | 7192 } |
| 7193 | |
|
18002
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
7194 DEFUN ("set-keyboard-coding-system-internal", |
|
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
7195 Fset_keyboard_coding_system_internal, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7196 Sset_keyboard_coding_system_internal, 1, 1, 0, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7197 doc: /* Internal use only. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7198 (coding_system) |
| 17052 | 7199 Lisp_Object coding_system; |
| 7200 { | |
|
40656
cdfd4d09b79a
Update usage of CHECK_ macros (remove unused second argument).
Pavel Jan?k <Pavel@Janik.cz>
parents:
40461
diff
changeset
|
7201 CHECK_SYMBOL (coding_system); |
| 88365 | 7202 setup_coding_system (Fcheck_coding_system (coding_system), |
| 7203 &keyboard_coding); | |
| 7204 /* Characer composition should be disabled. */ | |
| 7205 keyboard_coding.common_flags &= ~CODING_ANNOTATE_COMPOSITION_MASK; | |
| 17052 | 7206 return Qnil; |
| 7207 } | |
| 7208 | |
| 7209 DEFUN ("keyboard-coding-system", | |
| 7210 Fkeyboard_coding_system, Skeyboard_coding_system, 0, 0, 0, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7211 doc: /* Return coding system specified for decoding keyboard input. */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7212 () |
| 17052 | 7213 { |
| 88365 | 7214 return CODING_ID_NAME (keyboard_coding.id); |
| 17052 | 7215 } |
| 7216 | |
| 7217 | |
|
18536
69c0e220b626
(Vstandard_character_unification_table_for_decode):
Kenichi Handa <handa@m17n.org>
parents:
18523
diff
changeset
|
7218 DEFUN ("find-operation-coding-system", Ffind_operation_coding_system, |
|
69c0e220b626
(Vstandard_character_unification_table_for_decode):
Kenichi Handa <handa@m17n.org>
parents:
18523
diff
changeset
|
7219 Sfind_operation_coding_system, 1, MANY, 0, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7220 doc: /* Choose a coding system for an operation based on the target name. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7221 The value names a pair of coding systems: (DECODING-SYSTEM . ENCODING-SYSTEM). |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7222 DECODING-SYSTEM is the coding system to use for decoding |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7223 \(in case OPERATION does decoding), and ENCODING-SYSTEM is the coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7224 for encoding (in case OPERATION does encoding). |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7225 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7226 The first argument OPERATION specifies an I/O primitive: |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7227 For file I/O, `insert-file-contents' or `write-region'. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7228 For process I/O, `call-process', `call-process-region', or `start-process'. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7229 For network I/O, `open-network-stream'. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7230 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7231 The remaining arguments should be the same arguments that were passed |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7232 to the primitive. Depending on which primitive, one of those arguments |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7233 is selected as the TARGET. For example, if OPERATION does file I/O, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7234 whichever argument specifies the file name is TARGET. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7235 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7236 TARGET has a meaning which depends on OPERATION: |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7237 For file I/O, TARGET is a file name. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7238 For process I/O, TARGET is a process name. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7239 For network I/O, TARGET is a service name or a port number |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7240 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7241 This function looks up what specified for TARGET in, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7242 `file-coding-system-alist', `process-coding-system-alist', |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7243 or `network-coding-system-alist' depending on OPERATION. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7244 They may specify a coding system, a cons of coding systems, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7245 or a function symbol to call. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7246 In the last case, we call the function with one argument, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7247 which is a list of all the arguments given to this function. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7248 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7249 usage: (find-operation-coding-system OPERATION ARGUMENTS ...) */) |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
7250 (nargs, args) |
| 17052 | 7251 int nargs; |
| 7252 Lisp_Object *args; | |
| 7253 { | |
| 7254 Lisp_Object operation, target_idx, target, val; | |
| 7255 register Lisp_Object chain; | |
| 7256 | |
| 7257 if (nargs < 2) | |
| 7258 error ("Too few arguments"); | |
| 7259 operation = args[0]; | |
| 7260 if (!SYMBOLP (operation) | |
| 7261 || !INTEGERP (target_idx = Fget (operation, Qtarget_idx))) | |
| 88365 | 7262 error ("Invalid first arguement"); |
| 17052 | 7263 if (nargs < 1 + XINT (target_idx)) |
| 7264 error ("Too few arguments for operation: %s", | |
| 7265 XSYMBOL (operation)->name->data); | |
| 7266 target = args[XINT (target_idx) + 1]; | |
| 7267 if (!(STRINGP (target) | |
| 7268 || (EQ (operation, Qopen_network_stream) && INTEGERP (target)))) | |
| 88365 | 7269 error ("Invalid %dth argument", XINT (target_idx) + 1); |
| 17052 | 7270 |
|
18613
614b916ff5bf
Fix bugs with inappropriate mixing of Lisp_Object with int.
Richard M. Stallman <rms@gnu.org>
parents:
18536
diff
changeset
|
7271 chain = ((EQ (operation, Qinsert_file_contents) |
|
614b916ff5bf
Fix bugs with inappropriate mixing of Lisp_Object with int.
Richard M. Stallman <rms@gnu.org>
parents:
18536
diff
changeset
|
7272 || EQ (operation, Qwrite_region)) |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7273 ? Vfile_coding_system_alist |
|
18613
614b916ff5bf
Fix bugs with inappropriate mixing of Lisp_Object with int.
Richard M. Stallman <rms@gnu.org>
parents:
18536
diff
changeset
|
7274 : (EQ (operation, Qopen_network_stream) |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7275 ? Vnetwork_coding_system_alist |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7276 : Vprocess_coding_system_alist)); |
| 17052 | 7277 if (NILP (chain)) |
| 7278 return Qnil; | |
| 7279 | |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
7280 for (; CONSP (chain); chain = XCDR (chain)) |
| 17052 | 7281 { |
|
19747
bed06df9cbc5
(setup_coding_system, Ffind_operation_coding_system)
Richard M. Stallman <rms@gnu.org>
parents:
19743
diff
changeset
|
7282 Lisp_Object elt; |
| 88365 | 7283 |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
7284 elt = XCAR (chain); |
| 17052 | 7285 if (CONSP (elt) |
| 7286 && ((STRINGP (target) | |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
7287 && STRINGP (XCAR (elt)) |
|
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
7288 && fast_string_match (XCAR (elt), target) >= 0) |
|
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
7289 || (INTEGERP (target) && EQ (target, XCAR (elt))))) |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7290 { |
|
25662
0a7261c1d487
Use XCAR, XCDR, and XFLOAT_DATA instead of explicit member access.
Ken Raeburn <raeburn@raeburn.org>
parents:
25370
diff
changeset
|
7291 val = XCDR (elt); |
|
19763
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7292 /* Here, if VAL is both a valid coding system and a valid |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7293 function symbol, we return VAL as a coding system. */ |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7294 if (CONSP (val)) |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7295 return val; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7296 if (! SYMBOLP (val)) |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7297 return Qnil; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7298 if (! NILP (Fcoding_system_p (val))) |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7299 return Fcons (val, val); |
|
19763
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7300 if (! NILP (Ffboundp (val))) |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7301 { |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7302 val = call1 (val, Flist (nargs, args)); |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7303 if (CONSP (val)) |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7304 return val; |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7305 if (SYMBOLP (val) && ! NILP (Fcoding_system_p (val))) |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7306 return Fcons (val, val); |
|
ab2fd2c85986
(Ffind_operation_coding_system): If a function in
Kenichi Handa <handa@m17n.org>
parents:
19758
diff
changeset
|
7307 } |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7308 return Qnil; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
7309 } |
| 17052 | 7310 } |
| 7311 return Qnil; | |
| 7312 } | |
| 7313 | |
| 88365 | 7314 DEFUN ("set-coding-system-priority", Fset_coding_system_priority, |
|
88845
64b8f6168269
(Fset_coding_system_priority): Allow null arg list.
Dave Love <fx@gnu.org>
parents:
88771
diff
changeset
|
7315 Sset_coding_system_priority, 0, MANY, 0, |
| 88645 | 7316 doc: /* Assign higher priority to the coding systems given as arguments. |
|
88544
f464d728344c
(Vchar_coding_system_table, Qchar_coding_system):
Dave Love <fx@gnu.org>
parents:
88510
diff
changeset
|
7317 usage: (set-coding-system-priority CODING-SYSTEM ...) */) |
| 88365 | 7318 (nargs, args) |
| 7319 int nargs; | |
| 7320 Lisp_Object *args; | |
| 7321 { | |
| 7322 int i, j; | |
| 7323 int changed[coding_category_max]; | |
| 7324 enum coding_category priorities[coding_category_max]; | |
| 7325 | |
| 7326 bzero (changed, sizeof changed); | |
| 7327 | |
| 7328 for (i = j = 0; i < nargs; i++) | |
| 7329 { | |
| 7330 enum coding_category category; | |
| 7331 Lisp_Object spec, attrs; | |
| 7332 | |
| 7333 CHECK_CODING_SYSTEM_GET_SPEC (args[i], spec); | |
| 7334 attrs = AREF (spec, 0); | |
| 7335 category = XINT (CODING_ATTR_CATEGORY (attrs)); | |
| 7336 if (changed[category]) | |
| 7337 /* Ignore this coding system because a coding system of the | |
| 7338 same category already had a higher priority. */ | |
| 7339 continue; | |
| 7340 changed[category] = 1; | |
| 7341 priorities[j++] = category; | |
| 7342 if (coding_categories[category].id >= 0 | |
| 7343 && ! EQ (args[i], CODING_ID_NAME (coding_categories[category].id))) | |
| 7344 setup_coding_system (args[i], &coding_categories[category]); | |
| 7345 } | |
| 7346 | |
| 7347 /* Now we have decided top J priorities. Reflect the order of the | |
| 7348 original priorities to the remaining priorities. */ | |
| 7349 | |
| 7350 for (i = j, j = 0; i < coding_category_max; i++, j++) | |
| 7351 { | |
| 7352 while (j < coding_category_max | |
| 7353 && changed[coding_priorities[j]]) | |
| 7354 j++; | |
| 7355 if (j == coding_category_max) | |
| 7356 abort (); | |
| 7357 priorities[i] = coding_priorities[j]; | |
| 7358 } | |
| 7359 | |
| 7360 bcopy (priorities, coding_priorities, sizeof priorities); | |
| 7361 return Qnil; | |
| 7362 } | |
| 7363 | |
| 7364 DEFUN ("coding-system-priority-list", Fcoding_system_priority_list, | |
| 7365 Scoding_system_priority_list, 0, 1, 0, | |
| 88645 | 7366 doc: /* Return a list of coding systems ordered by their priorities. |
| 7367 HIGHESTP non-nil means just return the highest priority one. */) | |
| 88365 | 7368 (highestp) |
| 7369 Lisp_Object highestp; | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7370 { |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7371 int i; |
| 88365 | 7372 Lisp_Object val; |
| 7373 | |
| 7374 for (i = 0, val = Qnil; i < coding_category_max; i++) | |
| 7375 { | |
| 7376 enum coding_category category = coding_priorities[i]; | |
| 7377 int id = coding_categories[category].id; | |
| 7378 Lisp_Object attrs; | |
| 7379 | |
| 7380 if (id < 0) | |
| 7381 continue; | |
| 7382 attrs = CODING_ID_ATTRS (id); | |
| 7383 if (! NILP (highestp)) | |
| 7384 return CODING_ATTR_BASE_NAME (attrs); | |
| 7385 val = Fcons (CODING_ATTR_BASE_NAME (attrs), val); | |
| 7386 } | |
| 7387 return Fnreverse (val); | |
| 7388 } | |
| 7389 | |
|
88631
780b91d4a7e5
(setup_iso_safe_charsets): Fix arg decl for K&R.
Dave Love <fx@gnu.org>
parents:
88607
diff
changeset
|
7390 static char *suffixes[] = { "-unix", "-dos", "-mac" }; |
|
780b91d4a7e5
(setup_iso_safe_charsets): Fix arg decl for K&R.
Dave Love <fx@gnu.org>
parents:
88607
diff
changeset
|
7391 |
| 88365 | 7392 static Lisp_Object |
| 7393 make_subsidiaries (base) | |
| 7394 Lisp_Object base; | |
| 7395 { | |
| 7396 Lisp_Object subsidiaries; | |
| 7397 int base_name_len = STRING_BYTES (XSYMBOL (base)->name); | |
| 7398 char *buf = (char *) alloca (base_name_len + 6); | |
| 7399 int i; | |
| 7400 | |
| 7401 bcopy (XSYMBOL (base)->name->data, buf, base_name_len); | |
| 7402 subsidiaries = Fmake_vector (make_number (3), Qnil); | |
| 7403 for (i = 0; i < 3; i++) | |
| 7404 { | |
| 7405 bcopy (suffixes[i], buf + base_name_len, strlen (suffixes[i]) + 1); | |
| 7406 ASET (subsidiaries, i, intern (buf)); | |
| 7407 } | |
| 7408 return subsidiaries; | |
| 7409 } | |
| 7410 | |
| 7411 | |
| 7412 DEFUN ("define-coding-system-internal", Fdefine_coding_system_internal, | |
| 7413 Sdefine_coding_system_internal, coding_arg_max, MANY, 0, | |
|
88544
f464d728344c
(Vchar_coding_system_table, Qchar_coding_system):
Dave Love <fx@gnu.org>
parents:
88510
diff
changeset
|
7414 doc: /* For internal use only. |
|
f464d728344c
(Vchar_coding_system_table, Qchar_coding_system):
Dave Love <fx@gnu.org>
parents:
88510
diff
changeset
|
7415 usage: (define-coding-system-internal ...) */) |
| 88365 | 7416 (nargs, args) |
| 7417 int nargs; | |
| 7418 Lisp_Object *args; | |
| 7419 { | |
| 7420 Lisp_Object name; | |
| 7421 Lisp_Object spec_vec; /* [ ATTRS ALIASE EOL_TYPE ] */ | |
| 7422 Lisp_Object attrs; /* Vector of attributes. */ | |
| 7423 Lisp_Object eol_type; | |
| 7424 Lisp_Object aliases; | |
| 7425 Lisp_Object coding_type, charset_list, safe_charsets; | |
| 7426 enum coding_category category; | |
| 7427 Lisp_Object tail, val; | |
| 7428 int max_charset_id = 0; | |
| 7429 int i; | |
| 7430 | |
| 7431 if (nargs < coding_arg_max) | |
| 7432 goto short_args; | |
| 7433 | |
| 7434 attrs = Fmake_vector (make_number (coding_attr_last_index), Qnil); | |
| 7435 | |
| 7436 name = args[coding_arg_name]; | |
| 7437 CHECK_SYMBOL (name); | |
| 7438 CODING_ATTR_BASE_NAME (attrs) = name; | |
| 7439 | |
| 7440 val = args[coding_arg_mnemonic]; | |
| 7441 if (! STRINGP (val)) | |
| 7442 CHECK_CHARACTER (val); | |
| 7443 CODING_ATTR_MNEMONIC (attrs) = val; | |
| 7444 | |
| 7445 coding_type = args[coding_arg_coding_type]; | |
| 7446 CHECK_SYMBOL (coding_type); | |
| 7447 CODING_ATTR_TYPE (attrs) = coding_type; | |
| 7448 | |
| 7449 charset_list = args[coding_arg_charset_list]; | |
| 7450 if (SYMBOLP (charset_list)) | |
| 7451 { | |
| 7452 if (EQ (charset_list, Qiso_2022)) | |
| 7453 { | |
| 7454 if (! EQ (coding_type, Qiso_2022)) | |
| 7455 error ("Invalid charset-list"); | |
| 7456 charset_list = Viso_2022_charset_list; | |
| 7457 } | |
| 7458 else if (EQ (charset_list, Qemacs_mule)) | |
| 7459 { | |
| 7460 if (! EQ (coding_type, Qemacs_mule)) | |
| 7461 error ("Invalid charset-list"); | |
| 7462 charset_list = Vemacs_mule_charset_list; | |
| 7463 } | |
| 7464 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) | |
| 7465 if (max_charset_id < XFASTINT (XCAR (tail))) | |
| 7466 max_charset_id = XFASTINT (XCAR (tail)); | |
| 7467 } | |
| 7468 else | |
| 7469 { | |
| 7470 charset_list = Fcopy_sequence (charset_list); | |
| 7471 for (tail = charset_list; !NILP (tail); tail = Fcdr (tail)) | |
| 7472 { | |
| 7473 struct charset *charset; | |
| 7474 | |
| 7475 val = Fcar (tail); | |
| 7476 CHECK_CHARSET_GET_CHARSET (val, charset); | |
| 7477 if (EQ (coding_type, Qiso_2022) | |
| 7478 ? CHARSET_ISO_FINAL (charset) < 0 | |
| 7479 : EQ (coding_type, Qemacs_mule) | |
| 7480 ? CHARSET_EMACS_MULE_ID (charset) < 0 | |
| 7481 : 0) | |
| 7482 error ("Can't handle charset `%s'", | |
| 7483 XSYMBOL (CHARSET_NAME (charset))->name->data); | |
| 7484 | |
| 7485 XCAR (tail) = make_number (charset->id); | |
| 7486 if (max_charset_id < charset->id) | |
| 7487 max_charset_id = charset->id; | |
| 7488 } | |
| 7489 } | |
| 7490 CODING_ATTR_CHARSET_LIST (attrs) = charset_list; | |
| 7491 | |
| 7492 safe_charsets = Fmake_string (make_number (max_charset_id + 1), | |
| 7493 make_number (255)); | |
| 7494 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) | |
| 7495 XSTRING (safe_charsets)->data[XFASTINT (XCAR (tail))] = 0; | |
| 7496 CODING_ATTR_SAFE_CHARSETS (attrs) = safe_charsets; | |
| 7497 | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7498 CODING_ATTR_ASCII_COMPAT (attrs) = args[coding_arg_ascii_compatible_p]; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7499 |
| 88365 | 7500 val = args[coding_arg_decode_translation_table]; |
| 7501 if (! NILP (val)) | |
| 7502 CHECK_CHAR_TABLE (val); | |
| 7503 CODING_ATTR_DECODE_TBL (attrs) = val; | |
| 7504 | |
| 7505 val = args[coding_arg_encode_translation_table]; | |
| 7506 if (! NILP (val)) | |
| 7507 CHECK_CHAR_TABLE (val); | |
| 7508 CODING_ATTR_ENCODE_TBL (attrs) = val; | |
| 7509 | |
| 7510 val = args[coding_arg_post_read_conversion]; | |
| 7511 CHECK_SYMBOL (val); | |
| 7512 CODING_ATTR_POST_READ (attrs) = val; | |
| 7513 | |
| 7514 val = args[coding_arg_pre_write_conversion]; | |
| 7515 CHECK_SYMBOL (val); | |
| 7516 CODING_ATTR_PRE_WRITE (attrs) = val; | |
| 7517 | |
| 7518 val = args[coding_arg_default_char]; | |
| 7519 if (NILP (val)) | |
| 7520 CODING_ATTR_DEFAULT_CHAR (attrs) = make_number (' '); | |
| 7521 else | |
| 7522 { | |
| 7523 CHECK_CHARACTER (val); | |
| 7524 CODING_ATTR_DEFAULT_CHAR (attrs) = val; | |
| 7525 } | |
| 7526 | |
| 7527 val = args[coding_arg_plist]; | |
| 7528 CHECK_LIST (val); | |
| 7529 CODING_ATTR_PLIST (attrs) = val; | |
| 7530 | |
| 7531 if (EQ (coding_type, Qcharset)) | |
| 7532 { | |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7533 /* Generate a lisp vector of 256 elements. Each element is nil, |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7534 integer, or a list of charset IDs. |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7535 |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7536 If Nth element is nil, the byte code N is invalid in this |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7537 coding system. |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7538 |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7539 If Nth element is a number NUM, N is the first byte of a |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7540 charset whose ID is NUM. |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7541 |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7542 If Nth element is a list of charset IDs, N is the first byte |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7543 of one of them. The list is sorted by dimensions of the |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7544 charsets. A charset of smaller dimension comes firtst. |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7545 */ |
| 88365 | 7546 val = Fmake_vector (make_number (256), Qnil); |
| 7547 | |
| 7548 for (tail = charset_list; CONSP (tail); tail = XCDR (tail)) | |
| 7549 { | |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7550 struct charset *charset = CHARSET_FROM_ID (XFASTINT (XCAR (tail))); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7551 int dim = CHARSET_DIMENSION (charset); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7552 int idx = (dim - 1) * 4; |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7553 |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7554 if (CHARSET_ASCII_COMPATIBLE_P (charset)) |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7555 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7556 |
|
88477
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
7557 for (i = charset->code_space[idx]; |
|
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
7558 i <= charset->code_space[idx + 1]; i++) |
|
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
7559 { |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7560 Lisp_Object tmp, tmp2; |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7561 int dim2; |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7562 |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7563 tmp = AREF (val, i); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7564 if (NILP (tmp)) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7565 tmp = XCAR (tail); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7566 else if (NUMBERP (tmp)) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7567 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7568 dim2 = CHARSET_DIMENSION (CHARSET_FROM_ID (XFASTINT (tmp))); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7569 if (dim < dim2) |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
7570 tmp = Fcons (XCAR (tail), Fcons (tmp, Qnil)); |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7571 else |
|
88607
18436bf3d6dd
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
88598
diff
changeset
|
7572 tmp = Fcons (tmp, Fcons (XCAR (tail), Qnil)); |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7573 } |
|
88477
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
7574 else |
|
88597
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7575 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7576 for (tmp2 = tmp; CONSP (tmp2); tmp2 = XCDR (tmp2)) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7577 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7578 dim2 = CHARSET_DIMENSION (CHARSET_FROM_ID (XFASTINT (XCAR (tmp2)))); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7579 if (dim < dim2) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7580 break; |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7581 } |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7582 if (NILP (tmp2)) |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7583 tmp = nconc2 (tmp, Fcons (XCAR (tail), Qnil)); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7584 else |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7585 { |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7586 XSETCDR (tmp2, Fcons (XCAR (tmp2), XCDR (tmp2))); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7587 XSETCAR (tmp2, XCAR (tail)); |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7588 } |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7589 } |
|
74b74f59bc09
(decode_coding_charset): Adjusted for the change of
Kenichi Handa <handa@m17n.org>
parents:
88587
diff
changeset
|
7590 ASET (val, i, tmp); |
|
88477
5f974cbba7b3
(coding_set_source): Delete the local variable beg_byte.
Kenichi Handa <handa@m17n.org>
parents:
88473
diff
changeset
|
7591 } |
| 88365 | 7592 } |
| 7593 ASET (attrs, coding_attr_charset_valids, val); | |
| 7594 category = coding_category_charset; | |
| 7595 } | |
| 7596 else if (EQ (coding_type, Qccl)) | |
| 7597 { | |
| 7598 Lisp_Object valids; | |
| 7599 | |
| 7600 if (nargs < coding_arg_ccl_max) | |
| 7601 goto short_args; | |
| 7602 | |
| 7603 val = args[coding_arg_ccl_decoder]; | |
| 7604 CHECK_CCL_PROGRAM (val); | |
| 7605 if (VECTORP (val)) | |
| 7606 val = Fcopy_sequence (val); | |
| 7607 ASET (attrs, coding_attr_ccl_decoder, val); | |
| 7608 | |
| 7609 val = args[coding_arg_ccl_encoder]; | |
| 7610 CHECK_CCL_PROGRAM (val); | |
| 7611 if (VECTORP (val)) | |
| 7612 val = Fcopy_sequence (val); | |
| 7613 ASET (attrs, coding_attr_ccl_encoder, val); | |
| 7614 | |
| 7615 val = args[coding_arg_ccl_valids]; | |
| 7616 valids = Fmake_string (make_number (256), make_number (0)); | |
| 7617 for (tail = val; !NILP (tail); tail = Fcdr (tail)) | |
| 7618 { | |
| 7619 val = Fcar (tail); | |
| 7620 if (INTEGERP (val)) | |
| 88856 | 7621 ASET (valids, XINT (val), make_number (1)); |
| 88365 | 7622 else |
| 7623 { | |
| 7624 int from, to; | |
| 7625 | |
| 7626 CHECK_CONS (val); | |
| 7627 CHECK_NUMBER (XCAR (val)); | |
| 7628 CHECK_NUMBER (XCDR (val)); | |
| 7629 from = XINT (XCAR (val)); | |
| 7630 to = XINT (XCDR (val)); | |
| 7631 for (i = from; i <= to; i++) | |
| 88856 | 7632 ASET (valids, i, make_number (1)); |
| 88365 | 7633 } |
| 7634 } | |
| 7635 ASET (attrs, coding_attr_ccl_valids, valids); | |
| 7636 | |
| 7637 category = coding_category_ccl; | |
| 7638 } | |
| 7639 else if (EQ (coding_type, Qutf_16)) | |
| 7640 { | |
| 7641 Lisp_Object bom, endian; | |
| 7642 | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7643 CODING_ATTR_ASCII_COMPAT (attrs) = Qnil; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7644 |
| 88365 | 7645 if (nargs < coding_arg_utf16_max) |
| 7646 goto short_args; | |
| 7647 | |
| 7648 bom = args[coding_arg_utf16_bom]; | |
| 7649 if (! NILP (bom) && ! EQ (bom, Qt)) | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
7650 { |
| 88365 | 7651 CHECK_CONS (bom); |
| 7652 CHECK_CODING_SYSTEM (XCAR (bom)); | |
| 7653 CHECK_CODING_SYSTEM (XCDR (bom)); | |
| 7654 } | |
| 7655 ASET (attrs, coding_attr_utf_16_bom, bom); | |
| 7656 | |
| 7657 endian = args[coding_arg_utf16_endian]; | |
| 7658 ASET (attrs, coding_attr_utf_16_endian, endian); | |
| 7659 | |
| 7660 category = (CONSP (bom) | |
| 7661 ? coding_category_utf_16_auto | |
| 7662 : NILP (bom) | |
| 7663 ? (NILP (endian) | |
| 7664 ? coding_category_utf_16_be_nosig | |
| 7665 : coding_category_utf_16_le_nosig) | |
| 7666 : (NILP (endian) | |
| 7667 ? coding_category_utf_16_be | |
| 7668 : coding_category_utf_16_le)); | |
| 7669 } | |
| 7670 else if (EQ (coding_type, Qiso_2022)) | |
| 7671 { | |
| 7672 Lisp_Object initial, reg_usage, request, flags; | |
|
88430
6418a272b97e
* coding.c: Delete unused variables.
Kenichi Handa <handa@m17n.org>
parents:
88365
diff
changeset
|
7673 int i, id; |
| 88365 | 7674 |
| 7675 if (nargs < coding_arg_iso2022_max) | |
| 7676 goto short_args; | |
| 7677 | |
| 7678 initial = Fcopy_sequence (args[coding_arg_iso2022_initial]); | |
| 7679 CHECK_VECTOR (initial); | |
| 7680 for (i = 0; i < 4; i++) | |
| 7681 { | |
| 7682 val = Faref (initial, make_number (i)); | |
| 7683 if (! NILP (val)) | |
| 7684 { | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7685 struct charset *charset; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7686 |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7687 CHECK_CHARSET_GET_CHARSET (val, charset); |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7688 ASET (initial, i, make_number (CHARSET_ID (charset))); |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7689 if (i == 0 && CHARSET_ASCII_COMPATIBLE_P (charset)) |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7690 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
| 88365 | 7691 } |
| 7692 else | |
| 7693 ASET (initial, i, make_number (-1)); | |
| 7694 } | |
| 7695 | |
| 7696 reg_usage = args[coding_arg_iso2022_reg_usage]; | |
| 7697 CHECK_CONS (reg_usage); | |
| 7698 CHECK_NATNUM (XCAR (reg_usage)); | |
| 7699 CHECK_NATNUM (XCDR (reg_usage)); | |
| 7700 | |
| 7701 request = Fcopy_sequence (args[coding_arg_iso2022_request]); | |
| 7702 for (tail = request; ! NILP (tail); tail = Fcdr (tail)) | |
| 7703 { | |
| 7704 int id; | |
| 7705 | |
| 7706 val = Fcar (tail); | |
| 7707 CHECK_CONS (val); | |
| 7708 CHECK_CHARSET_GET_ID (XCAR (val), id); | |
| 7709 CHECK_NATNUM (XCDR (val)); | |
| 7710 if (XINT (XCDR (val)) >= 4) | |
| 7711 error ("Invalid graphic register number: %d", XINT (XCDR (val))); | |
| 7712 XCAR (val) = make_number (id); | |
| 7713 } | |
| 7714 | |
| 7715 flags = args[coding_arg_iso2022_flags]; | |
| 7716 CHECK_NATNUM (flags); | |
| 7717 i = XINT (flags); | |
| 7718 if (EQ (args[coding_arg_charset_list], Qiso_2022)) | |
| 7719 flags = make_number (i | CODING_ISO_FLAG_FULL_SUPPORT); | |
| 7720 | |
| 7721 ASET (attrs, coding_attr_iso_initial, initial); | |
| 7722 ASET (attrs, coding_attr_iso_usage, reg_usage); | |
| 7723 ASET (attrs, coding_attr_iso_request, request); | |
| 7724 ASET (attrs, coding_attr_iso_flags, flags); | |
| 7725 setup_iso_safe_charsets (attrs); | |
| 7726 | |
| 7727 if (i & CODING_ISO_FLAG_SEVEN_BITS) | |
| 7728 category = ((i & (CODING_ISO_FLAG_LOCKING_SHIFT | |
| 7729 | CODING_ISO_FLAG_SINGLE_SHIFT)) | |
| 7730 ? coding_category_iso_7_else | |
| 7731 : EQ (args[coding_arg_charset_list], Qiso_2022) | |
| 7732 ? coding_category_iso_7 | |
| 7733 : coding_category_iso_7_tight); | |
| 7734 else | |
| 7735 { | |
| 7736 int id = XINT (AREF (initial, 1)); | |
| 7737 | |
|
88977
3b05c02eebf2
(Fdefine_coding_system_internal): Fix category setting
Kenichi Handa <handa@m17n.org>
parents:
88950
diff
changeset
|
7738 category = (((i & CODING_ISO_FLAG_LOCKING_SHIFT) |
| 88365 | 7739 || EQ (args[coding_arg_charset_list], Qiso_2022) |
| 7740 || id < 0) | |
| 7741 ? coding_category_iso_8_else | |
| 7742 : (CHARSET_DIMENSION (CHARSET_FROM_ID (id)) == 1) | |
| 7743 ? coding_category_iso_8_1 | |
| 7744 : coding_category_iso_8_2); | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
7745 } |
|
89227
101ee928c088
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89225
diff
changeset
|
7746 if (category != coding_category_iso_8_1 |
|
101ee928c088
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89225
diff
changeset
|
7747 && category != coding_category_iso_8_2) |
|
101ee928c088
(Fdefine_coding_system_internal): Fix previous change.
Kenichi Handa <handa@m17n.org>
parents:
89225
diff
changeset
|
7748 CODING_ATTR_ASCII_COMPAT (attrs) = Qnil; |
| 88365 | 7749 } |
| 7750 else if (EQ (coding_type, Qemacs_mule)) | |
| 7751 { | |
| 7752 if (EQ (args[coding_arg_charset_list], Qemacs_mule)) | |
| 7753 ASET (attrs, coding_attr_emacs_mule_full, Qt); | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7754 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
| 88365 | 7755 category = coding_category_emacs_mule; |
| 7756 } | |
| 7757 else if (EQ (coding_type, Qshift_jis)) | |
| 7758 { | |
| 7759 | |
| 7760 struct charset *charset; | |
| 7761 | |
| 7762 if (XINT (Flength (charset_list)) != 3) | |
| 7763 error ("There should be just three charsets"); | |
| 7764 | |
| 7765 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 7766 if (CHARSET_DIMENSION (charset) != 1) | |
| 7767 error ("Dimension of charset %s is not one", | |
| 7768 XSYMBOL (CHARSET_NAME (charset))->name->data); | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7769 if (CHARSET_ASCII_COMPATIBLE_P (charset)) |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7770 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
| 88365 | 7771 |
| 7772 charset_list = XCDR (charset_list); | |
| 7773 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 7774 if (CHARSET_DIMENSION (charset) != 1) | |
| 7775 error ("Dimension of charset %s is not one", | |
| 7776 XSYMBOL (CHARSET_NAME (charset))->name->data); | |
| 7777 | |
| 7778 charset_list = XCDR (charset_list); | |
| 7779 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 7780 if (CHARSET_DIMENSION (charset) != 2) | |
| 7781 error ("Dimension of charset %s is not two", | |
| 7782 XSYMBOL (CHARSET_NAME (charset))->name->data); | |
| 7783 | |
| 7784 category = coding_category_sjis; | |
| 7785 Vsjis_coding_system = name; | |
| 7786 } | |
| 7787 else if (EQ (coding_type, Qbig5)) | |
| 7788 { | |
| 7789 struct charset *charset; | |
| 7790 | |
| 7791 if (XINT (Flength (charset_list)) != 2) | |
| 7792 error ("There should be just two charsets"); | |
| 7793 | |
| 7794 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 7795 if (CHARSET_DIMENSION (charset) != 1) | |
| 7796 error ("Dimension of charset %s is not one", | |
| 7797 XSYMBOL (CHARSET_NAME (charset))->name->data); | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7798 if (CHARSET_ASCII_COMPATIBLE_P (charset)) |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7799 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
| 88365 | 7800 |
| 7801 charset_list = XCDR (charset_list); | |
| 7802 charset = CHARSET_FROM_ID (XINT (XCAR (charset_list))); | |
| 7803 if (CHARSET_DIMENSION (charset) != 2) | |
| 7804 error ("Dimension of charset %s is not two", | |
| 7805 XSYMBOL (CHARSET_NAME (charset))->name->data); | |
| 7806 | |
| 7807 category = coding_category_big5; | |
| 7808 Vbig5_coding_system = name; | |
| 7809 } | |
| 7810 else if (EQ (coding_type, Qraw_text)) | |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7811 { |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7812 category = coding_category_raw_text; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7813 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7814 } |
| 88365 | 7815 else if (EQ (coding_type, Qutf_8)) |
|
89225
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7816 { |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7817 category = coding_category_utf_8; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7818 CODING_ATTR_ASCII_COMPAT (attrs) = Qt; |
|
32058afc72e2
(detect_coding_charset): If only ASCII bytes are found, return 0.
Kenichi Handa <handa@m17n.org>
parents:
89221
diff
changeset
|
7819 } |
| 88365 | 7820 else if (EQ (coding_type, Qundecided)) |
| 7821 category = coding_category_undecided; | |
| 7822 else | |
| 7823 error ("Invalid coding system type: %s", | |
| 7824 XSYMBOL (coding_type)->name->data); | |
| 7825 | |
| 7826 CODING_ATTR_CATEGORY (attrs) = make_number (category); | |
| 7827 | |
| 7828 eol_type = args[coding_arg_eol_type]; | |
| 7829 if (! NILP (eol_type) | |
| 7830 && ! EQ (eol_type, Qunix) | |
| 7831 && ! EQ (eol_type, Qdos) | |
| 7832 && ! EQ (eol_type, Qmac)) | |
| 7833 error ("Invalid eol-type"); | |
| 7834 | |
| 7835 aliases = Fcons (name, Qnil); | |
| 7836 | |
| 7837 if (NILP (eol_type)) | |
| 7838 { | |
| 7839 eol_type = make_subsidiaries (name); | |
| 7840 for (i = 0; i < 3; i++) | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
7841 { |
| 88365 | 7842 Lisp_Object this_spec, this_name, this_aliases, this_eol_type; |
| 7843 | |
| 7844 this_name = AREF (eol_type, i); | |
| 7845 this_aliases = Fcons (this_name, Qnil); | |
| 7846 this_eol_type = (i == 0 ? Qunix : i == 1 ? Qdos : Qmac); | |
| 7847 this_spec = Fmake_vector (make_number (3), attrs); | |
| 7848 ASET (this_spec, 1, this_aliases); | |
| 7849 ASET (this_spec, 2, this_eol_type); | |
| 7850 Fputhash (this_name, this_spec, Vcoding_system_hash_table); | |
| 7851 Vcoding_system_list = Fcons (this_name, Vcoding_system_list); | |
| 7852 Vcoding_system_alist = Fcons (Fcons (Fsymbol_name (this_name), Qnil), | |
| 7853 Vcoding_system_alist); | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
7854 } |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7855 } |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
7856 |
| 88365 | 7857 spec_vec = Fmake_vector (make_number (3), attrs); |
| 7858 ASET (spec_vec, 1, aliases); | |
| 7859 ASET (spec_vec, 2, eol_type); | |
| 7860 | |
| 7861 Fputhash (name, spec_vec, Vcoding_system_hash_table); | |
| 7862 Vcoding_system_list = Fcons (name, Vcoding_system_list); | |
| 7863 Vcoding_system_alist = Fcons (Fcons (Fsymbol_name (name), Qnil), | |
| 7864 Vcoding_system_alist); | |
| 7865 | |
| 7866 { | |
| 7867 int id = coding_categories[category].id; | |
| 7868 | |
| 7869 if (id < 0 || EQ (name, CODING_ID_NAME (id))) | |
| 7870 setup_coding_system (name, &coding_categories[category]); | |
| 7871 } | |
| 7872 | |
| 7873 return Qnil; | |
| 7874 | |
| 7875 short_args: | |
| 7876 return Fsignal (Qwrong_number_of_arguments, | |
| 7877 Fcons (intern ("define-coding-system-internal"), | |
| 7878 make_number (nargs))); | |
| 7879 } | |
| 7880 | |
| 88645 | 7881 /* Fixme: should this record the alias relationships for |
| 7882 diagnostics? */ | |
| 88365 | 7883 DEFUN ("define-coding-system-alias", Fdefine_coding_system_alias, |
| 7884 Sdefine_coding_system_alias, 2, 2, 0, | |
| 7885 doc: /* Define ALIAS as an alias for CODING-SYSTEM. */) | |
| 7886 (alias, coding_system) | |
| 7887 Lisp_Object alias, coding_system; | |
| 7888 { | |
| 7889 Lisp_Object spec, aliases, eol_type; | |
| 7890 | |
| 7891 CHECK_SYMBOL (alias); | |
| 7892 CHECK_CODING_SYSTEM_GET_SPEC (coding_system, spec); | |
| 7893 aliases = AREF (spec, 1); | |
| 7894 while (!NILP (XCDR (aliases))) | |
| 7895 aliases = XCDR (aliases); | |
| 7896 XCDR (aliases) = Fcons (alias, Qnil); | |
| 7897 | |
| 7898 eol_type = AREF (spec, 2); | |
| 7899 if (VECTORP (eol_type)) | |
| 7900 { | |
| 7901 Lisp_Object subsidiaries; | |
| 7902 int i; | |
| 7903 | |
| 7904 subsidiaries = make_subsidiaries (alias); | |
| 7905 for (i = 0; i < 3; i++) | |
| 7906 Fdefine_coding_system_alias (AREF (subsidiaries, i), | |
| 7907 AREF (eol_type, i)); | |
| 7908 | |
| 7909 ASET (spec, 2, subsidiaries); | |
| 7910 } | |
| 7911 | |
| 7912 Fputhash (alias, spec, Vcoding_system_hash_table); | |
| 88485 | 7913 Vcoding_system_alist = Fcons (Fcons (Fsymbol_name (alias), Qnil), |
| 7914 Vcoding_system_alist); | |
| 88365 | 7915 |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7916 return Qnil; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7917 } |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
7918 |
| 88365 | 7919 DEFUN ("coding-system-base", Fcoding_system_base, Scoding_system_base, |
| 7920 1, 1, 0, | |
| 7921 doc: /* Return the base of CODING-SYSTEM. | |
| 88645 | 7922 Any alias or subsidiary coding system is not a base coding system. */) |
| 88365 | 7923 (coding_system) |
| 7924 Lisp_Object coding_system; | |
| 7925 { | |
| 7926 Lisp_Object spec, attrs; | |
| 7927 | |
| 7928 if (NILP (coding_system)) | |
| 7929 return (Qno_conversion); | |
| 7930 CHECK_CODING_SYSTEM_GET_SPEC (coding_system, spec); | |
| 7931 attrs = AREF (spec, 0); | |
| 7932 return CODING_ATTR_BASE_NAME (attrs); | |
| 7933 } | |
| 7934 | |
| 7935 DEFUN ("coding-system-plist", Fcoding_system_plist, Scoding_system_plist, | |
| 7936 1, 1, 0, | |
| 7937 doc: "Return the property list of CODING-SYSTEM.") | |
| 7938 (coding_system) | |
| 7939 Lisp_Object coding_system; | |
|
22226
557fac086b1b
(ascii_skip_code): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22186
diff
changeset
|
7940 { |
| 88365 | 7941 Lisp_Object spec, attrs; |
| 7942 | |
| 7943 if (NILP (coding_system)) | |
| 7944 coding_system = Qno_conversion; | |
| 7945 CHECK_CODING_SYSTEM_GET_SPEC (coding_system, spec); | |
| 7946 attrs = AREF (spec, 0); | |
| 7947 return CODING_ATTR_PLIST (attrs); | |
| 7948 } | |
| 7949 | |
| 7950 | |
| 7951 DEFUN ("coding-system-aliases", Fcoding_system_aliases, Scoding_system_aliases, | |
| 7952 1, 1, 0, | |
| 88645 | 7953 doc: /* Return the list of aliases of CODING-SYSTEM. */) |
| 88365 | 7954 (coding_system) |
| 7955 Lisp_Object coding_system; | |
| 7956 { | |
| 7957 Lisp_Object spec; | |
| 7958 | |
| 7959 if (NILP (coding_system)) | |
| 7960 coding_system = Qno_conversion; | |
| 7961 CHECK_CODING_SYSTEM_GET_SPEC (coding_system, spec); | |
| 88645 | 7962 return AREF (spec, 1); |
| 88365 | 7963 } |
| 7964 | |
| 7965 DEFUN ("coding-system-eol-type", Fcoding_system_eol_type, | |
| 7966 Scoding_system_eol_type, 1, 1, 0, | |
| 7967 doc: /* Return eol-type of CODING-SYSTEM. | |
| 7968 An eol-type is integer 0, 1, 2, or a vector of coding systems. | |
| 7969 | |
| 7970 Integer values 0, 1, and 2 indicate a format of end-of-line; LF, CRLF, | |
| 7971 and CR respectively. | |
| 7972 | |
| 7973 A vector value indicates that a format of end-of-line should be | |
| 7974 detected automatically. Nth element of the vector is the subsidiary | |
| 7975 coding system whose eol-type is N. */) | |
| 7976 (coding_system) | |
| 7977 Lisp_Object coding_system; | |
| 7978 { | |
| 7979 Lisp_Object spec, eol_type; | |
| 7980 int n; | |
| 7981 | |
| 7982 if (NILP (coding_system)) | |
| 7983 coding_system = Qno_conversion; | |
| 7984 if (! CODING_SYSTEM_P (coding_system)) | |
| 7985 return Qnil; | |
| 7986 spec = CODING_SYSTEM_SPEC (coding_system); | |
| 7987 eol_type = AREF (spec, 2); | |
| 7988 if (VECTORP (eol_type)) | |
| 7989 return Fcopy_sequence (eol_type); | |
| 7990 n = EQ (eol_type, Qunix) ? 0 : EQ (eol_type, Qdos) ? 1 : 2; | |
| 7991 return make_number (n); | |
|
22226
557fac086b1b
(ascii_skip_code): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22186
diff
changeset
|
7992 } |
|
557fac086b1b
(ascii_skip_code): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22186
diff
changeset
|
7993 |
| 17052 | 7994 #endif /* emacs */ |
| 7995 | |
| 7996 | |
|
22874
b133f07a76db
(Qvalid_codes): New variable.
Kenichi Handa <handa@m17n.org>
parents:
22812
diff
changeset
|
7997 /*** 9. Post-amble ***/ |
| 17052 | 7998 |
| 21514 | 7999 void |
| 17052 | 8000 init_coding_once () |
| 8001 { | |
| 8002 int i; | |
| 8003 | |
| 88365 | 8004 for (i = 0; i < coding_category_max; i++) |
| 8005 { | |
| 8006 coding_categories[i].id = -1; | |
| 8007 coding_priorities[i] = i; | |
| 8008 } | |
| 17052 | 8009 |
| 8010 /* ISO2022 specific initialize routine. */ | |
| 8011 for (i = 0; i < 0x20; i++) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
8012 iso_code_class[i] = ISO_control_0; |
| 17052 | 8013 for (i = 0x21; i < 0x7F; i++) |
| 8014 iso_code_class[i] = ISO_graphic_plane_0; | |
| 8015 for (i = 0x80; i < 0xA0; i++) | |
|
29005
b396df3a5181
(ONE_MORE_BYTE, TWO_MORE_BYTES): Set coding->resutl to
Kenichi Handa <handa@m17n.org>
parents:
28512
diff
changeset
|
8016 iso_code_class[i] = ISO_control_1; |
| 17052 | 8017 for (i = 0xA1; i < 0xFF; i++) |
| 8018 iso_code_class[i] = ISO_graphic_plane_1; | |
| 8019 iso_code_class[0x20] = iso_code_class[0x7F] = ISO_0x20_or_0x7F; | |
| 8020 iso_code_class[0xA0] = iso_code_class[0xFF] = ISO_0xA0_or_0xFF; | |
| 8021 iso_code_class[ISO_CODE_CR] = ISO_carriage_return; | |
| 8022 iso_code_class[ISO_CODE_SO] = ISO_shift_out; | |
| 8023 iso_code_class[ISO_CODE_SI] = ISO_shift_in; | |
| 8024 iso_code_class[ISO_CODE_SS2_7] = ISO_single_shift_2_7; | |
| 8025 iso_code_class[ISO_CODE_ESC] = ISO_escape; | |
| 8026 iso_code_class[ISO_CODE_SS2] = ISO_single_shift_2; | |
| 8027 iso_code_class[ISO_CODE_SS3] = ISO_single_shift_3; | |
| 8028 iso_code_class[ISO_CODE_CSI] = ISO_control_sequence_introducer; | |
| 8029 | |
|
26067
f54ca66e2571
(code_convert_string): Add record_unwind_protect to
Kenichi Handa <handa@m17n.org>
parents:
25860
diff
changeset
|
8030 inhibit_pre_post_conversion = 0; |
| 88365 | 8031 |
| 8032 for (i = 0; i < 256; i++) | |
| 8033 { | |
| 8034 emacs_mule_bytes[i] = 1; | |
| 8035 } | |
|
88876
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
8036 emacs_mule_bytes[EMACS_MULE_LEADING_CODE_PRIVATE_11] = 3; |
|
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
8037 emacs_mule_bytes[EMACS_MULE_LEADING_CODE_PRIVATE_12] = 3; |
|
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
8038 emacs_mule_bytes[EMACS_MULE_LEADING_CODE_PRIVATE_21] = 4; |
|
af9012fdad56
(LEADING_CODE_PRIVATE_11, LEADING_CODE_PRIVATE_12,
Kenichi Handa <handa@m17n.org>
parents:
88862
diff
changeset
|
8039 emacs_mule_bytes[EMACS_MULE_LEADING_CODE_PRIVATE_22] = 4; |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8040 } |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8041 |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8042 #ifdef emacs |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8043 |
| 21514 | 8044 void |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8045 syms_of_coding () |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8046 { |
| 88365 | 8047 staticpro (&Vcoding_system_hash_table); |
| 8048 Vcoding_system_hash_table = Fmakehash (Qeq); | |
| 8049 | |
| 8050 staticpro (&Vsjis_coding_system); | |
| 8051 Vsjis_coding_system = Qnil; | |
| 8052 | |
| 8053 staticpro (&Vbig5_coding_system); | |
| 8054 Vbig5_coding_system = Qnil; | |
| 8055 | |
| 8056 staticpro (&Vcode_conversion_work_buf_list); | |
| 8057 Vcode_conversion_work_buf_list = Qnil; | |
| 8058 | |
| 8059 staticpro (&Vcode_conversion_reused_work_buf); | |
| 8060 Vcode_conversion_reused_work_buf = Qnil; | |
| 8061 | |
| 8062 DEFSYM (Qcharset, "charset"); | |
| 8063 DEFSYM (Qtarget_idx, "target-idx"); | |
| 8064 DEFSYM (Qcoding_system_history, "coding-system-history"); | |
|
19750
95e4e1cba6ac
(Qcoding_system_history): New variable.
Richard M. Stallman <rms@gnu.org>
parents:
19747
diff
changeset
|
8065 Fset (Qcoding_system_history, Qnil); |
|
95e4e1cba6ac
(Qcoding_system_history): New variable.
Richard M. Stallman <rms@gnu.org>
parents:
19747
diff
changeset
|
8066 |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8067 /* Target FILENAME is the first argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8068 Fput (Qinsert_file_contents, Qtarget_idx, make_number (0)); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8069 /* Target FILENAME is the third argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8070 Fput (Qwrite_region, Qtarget_idx, make_number (2)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8071 |
| 88365 | 8072 DEFSYM (Qcall_process, "call-process"); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8073 /* Target PROGRAM is the first argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8074 Fput (Qcall_process, Qtarget_idx, make_number (0)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8075 |
| 88365 | 8076 DEFSYM (Qcall_process_region, "call-process-region"); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8077 /* Target PROGRAM is the third argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8078 Fput (Qcall_process_region, Qtarget_idx, make_number (2)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8079 |
| 88365 | 8080 DEFSYM (Qstart_process, "start-process"); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8081 /* Target PROGRAM is the third argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8082 Fput (Qstart_process, Qtarget_idx, make_number (2)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8083 |
| 88365 | 8084 DEFSYM (Qopen_network_stream, "open-network-stream"); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8085 /* Target SERVICE is the fourth argument. */ |
|
17119
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8086 Fput (Qopen_network_stream, Qtarget_idx, make_number (3)); |
|
2cfb31c15ced
(create_process, Fopen_network_stream): Typo in indexes
Kenichi Handa <handa@m17n.org>
parents:
17071
diff
changeset
|
8087 |
| 88365 | 8088 DEFSYM (Qcoding_system, "coding-system"); |
| 8089 DEFSYM (Qcoding_aliases, "coding-aliases"); | |
| 8090 | |
| 8091 DEFSYM (Qeol_type, "eol-type"); | |
| 8092 DEFSYM (Qunix, "unix"); | |
| 8093 DEFSYM (Qdos, "dos"); | |
| 8094 | |
| 8095 DEFSYM (Qbuffer_file_coding_system, "buffer-file-coding-system"); | |
| 8096 DEFSYM (Qpost_read_conversion, "post-read-conversion"); | |
| 8097 DEFSYM (Qpre_write_conversion, "pre-write-conversion"); | |
| 8098 DEFSYM (Qdefault_char, "default-char"); | |
| 8099 DEFSYM (Qundecided, "undecided"); | |
| 8100 DEFSYM (Qno_conversion, "no-conversion"); | |
| 8101 DEFSYM (Qraw_text, "raw-text"); | |
| 8102 | |
| 8103 DEFSYM (Qiso_2022, "iso-2022"); | |
| 8104 | |
| 8105 DEFSYM (Qutf_8, "utf-8"); | |
| 8106 | |
| 8107 DEFSYM (Qutf_16, "utf-16"); | |
| 8108 DEFSYM (Qutf_16_be, "utf-16-be"); | |
| 8109 DEFSYM (Qutf_16_be_nosig, "utf-16-be-nosig"); | |
| 8110 DEFSYM (Qutf_16_le, "utf-16-l3"); | |
| 8111 DEFSYM (Qutf_16_le_nosig, "utf-16-le-nosig"); | |
| 8112 DEFSYM (Qsignature, "signature"); | |
| 8113 DEFSYM (Qendian, "endian"); | |
| 8114 DEFSYM (Qbig, "big"); | |
| 8115 DEFSYM (Qlittle, "little"); | |
| 8116 | |
| 8117 DEFSYM (Qshift_jis, "shift-jis"); | |
| 8118 DEFSYM (Qbig5, "big5"); | |
| 8119 | |
| 8120 DEFSYM (Qcoding_system_p, "coding-system-p"); | |
| 8121 | |
| 8122 DEFSYM (Qcoding_system_error, "coding-system-error"); | |
| 17052 | 8123 Fput (Qcoding_system_error, Qerror_conditions, |
| 8124 Fcons (Qcoding_system_error, Fcons (Qerror, Qnil))); | |
| 8125 Fput (Qcoding_system_error, Qerror_message, | |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8126 build_string ("Invalid coding system")); |
| 17052 | 8127 |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
8128 /* Intern this now in case it isn't already done. |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
8129 Setting this variable twice is harmless. |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
8130 But don't staticpro it here--that is done in alloc.c. */ |
|
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
8131 Qchar_table_extra_slots = intern ("char-table-extra-slots"); |
| 88365 | 8132 |
| 8133 DEFSYM (Qtranslation_table, "translation-table"); | |
| 8134 Fput (Qtranslation_table, Qchar_table_extra_slots, make_number (1)); | |
| 8135 DEFSYM (Qtranslation_table_id, "translation-table-id"); | |
| 8136 DEFSYM (Qtranslation_table_for_decode, "translation-table-for-decode"); | |
| 8137 DEFSYM (Qtranslation_table_for_encode, "translation-table-for-encode"); | |
| 8138 | |
| 8139 DEFSYM (Qvalid_codes, "valid-codes"); | |
| 8140 | |
| 8141 DEFSYM (Qemacs_mule, "emacs-mule"); | |
| 8142 | |
| 8143 Vcoding_category_table | |
| 8144 = Fmake_vector (make_number (coding_category_max), Qnil); | |
| 8145 staticpro (&Vcoding_category_table); | |
| 8146 /* Followings are target of code detection. */ | |
| 8147 ASET (Vcoding_category_table, coding_category_iso_7, | |
| 8148 intern ("coding-category-iso-7")); | |
| 8149 ASET (Vcoding_category_table, coding_category_iso_7_tight, | |
| 8150 intern ("coding-category-iso-7-tight")); | |
| 8151 ASET (Vcoding_category_table, coding_category_iso_8_1, | |
| 8152 intern ("coding-category-iso-8-1")); | |
| 8153 ASET (Vcoding_category_table, coding_category_iso_8_2, | |
| 8154 intern ("coding-category-iso-8-2")); | |
| 8155 ASET (Vcoding_category_table, coding_category_iso_7_else, | |
| 8156 intern ("coding-category-iso-7-else")); | |
| 8157 ASET (Vcoding_category_table, coding_category_iso_8_else, | |
| 8158 intern ("coding-category-iso-8-else")); | |
| 8159 ASET (Vcoding_category_table, coding_category_utf_8, | |
| 8160 intern ("coding-category-utf-8")); | |
| 8161 ASET (Vcoding_category_table, coding_category_utf_16_be, | |
| 8162 intern ("coding-category-utf-16-be")); | |
| 8163 ASET (Vcoding_category_table, coding_category_utf_16_le, | |
| 8164 intern ("coding-category-utf-16-le")); | |
| 8165 ASET (Vcoding_category_table, coding_category_utf_16_be_nosig, | |
| 8166 intern ("coding-category-utf-16-be-nosig")); | |
| 8167 ASET (Vcoding_category_table, coding_category_utf_16_le_nosig, | |
| 8168 intern ("coding-category-utf-16-le-nosig")); | |
| 8169 ASET (Vcoding_category_table, coding_category_charset, | |
| 8170 intern ("coding-category-charset")); | |
| 8171 ASET (Vcoding_category_table, coding_category_sjis, | |
| 8172 intern ("coding-category-sjis")); | |
| 8173 ASET (Vcoding_category_table, coding_category_big5, | |
| 8174 intern ("coding-category-big5")); | |
| 8175 ASET (Vcoding_category_table, coding_category_ccl, | |
| 8176 intern ("coding-category-ccl")); | |
| 8177 ASET (Vcoding_category_table, coding_category_emacs_mule, | |
| 8178 intern ("coding-category-emacs-mule")); | |
| 8179 /* Followings are NOT target of code detection. */ | |
| 8180 ASET (Vcoding_category_table, coding_category_raw_text, | |
| 8181 intern ("coding-category-raw-text")); | |
| 8182 ASET (Vcoding_category_table, coding_category_undecided, | |
| 8183 intern ("coding-category-undecided")); | |
| 8184 | |
| 17052 | 8185 defsubr (&Scoding_system_p); |
| 8186 defsubr (&Sread_coding_system); | |
| 8187 defsubr (&Sread_non_nil_coding_system); | |
| 8188 defsubr (&Scheck_coding_system); | |
| 8189 defsubr (&Sdetect_coding_region); | |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8190 defsubr (&Sdetect_coding_string); |
|
30487
6165da9c89c6
(Qsafe_charsets): This variable deleted.
Kenichi Handa <handa@m17n.org>
parents:
30384
diff
changeset
|
8191 defsubr (&Sfind_coding_systems_region_internal); |
| 88365 | 8192 defsubr (&Scheck_coding_systems_region); |
| 17052 | 8193 defsubr (&Sdecode_coding_region); |
| 8194 defsubr (&Sencode_coding_region); | |
| 8195 defsubr (&Sdecode_coding_string); | |
| 8196 defsubr (&Sencode_coding_string); | |
| 8197 defsubr (&Sdecode_sjis_char); | |
| 8198 defsubr (&Sencode_sjis_char); | |
| 8199 defsubr (&Sdecode_big5_char); | |
| 8200 defsubr (&Sencode_big5_char); | |
|
18002
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
8201 defsubr (&Sset_terminal_coding_system_internal); |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8202 defsubr (&Sset_safe_terminal_coding_system_internal); |
| 17052 | 8203 defsubr (&Sterminal_coding_system); |
|
18002
a14261786239
(encode_invocation_designation): Use macro
Kenichi Handa <handa@m17n.org>
parents:
17835
diff
changeset
|
8204 defsubr (&Sset_keyboard_coding_system_internal); |
| 17052 | 8205 defsubr (&Skeyboard_coding_system); |
|
18536
69c0e220b626
(Vstandard_character_unification_table_for_decode):
Kenichi Handa <handa@m17n.org>
parents:
18523
diff
changeset
|
8206 defsubr (&Sfind_operation_coding_system); |
| 88365 | 8207 defsubr (&Sset_coding_system_priority); |
| 8208 defsubr (&Sdefine_coding_system_internal); | |
| 8209 defsubr (&Sdefine_coding_system_alias); | |
| 8210 defsubr (&Scoding_system_base); | |
| 8211 defsubr (&Scoding_system_plist); | |
| 8212 defsubr (&Scoding_system_aliases); | |
| 8213 defsubr (&Scoding_system_eol_type); | |
| 8214 defsubr (&Scoding_system_priority_list); | |
| 17052 | 8215 |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
8216 DEFVAR_LISP ("coding-system-list", &Vcoding_system_list, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8217 doc: /* List of coding systems. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8218 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8219 Do not alter the value of this variable manually. This variable should be |
| 88365 | 8220 updated by the functions `define-coding-system' and |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8221 `define-coding-system-alias'. */); |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
8222 Vcoding_system_list = Qnil; |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
8223 |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
8224 DEFVAR_LISP ("coding-system-alist", &Vcoding_system_alist, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8225 doc: /* Alist of coding system names. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8226 Each element is one element list of coding system name. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8227 This variable is given to `completing-read' as TABLE argument. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8228 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8229 Do not alter the value of this variable manually. This variable should be |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8230 updated by the functions `make-coding-system' and |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8231 `define-coding-system-alias'. */); |
|
20105
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
8232 Vcoding_system_alist = Qnil; |
|
c017642863c2
(Qcoding_system_spec): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
19824
diff
changeset
|
8233 |
| 17052 | 8234 DEFVAR_LISP ("coding-category-list", &Vcoding_category_list, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8235 doc: /* List of coding-categories (symbols) ordered by priority. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8236 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8237 On detecting a coding system, Emacs tries code detection algorithms |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8238 associated with each coding-category one by one in this order. When |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8239 one algorithm agrees with a byte sequence of source text, the coding |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8240 system bound to the corresponding coding-category is selected. */); |
| 17052 | 8241 { |
| 8242 int i; | |
| 8243 | |
| 8244 Vcoding_category_list = Qnil; | |
| 88365 | 8245 for (i = coding_category_max - 1; i >= 0; i--) |
| 17052 | 8246 Vcoding_category_list |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8247 = Fcons (XVECTOR (Vcoding_category_table)->contents[i], |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8248 Vcoding_category_list); |
| 17052 | 8249 } |
| 8250 | |
| 8251 DEFVAR_LISP ("coding-system-for-read", &Vcoding_system_for_read, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8252 doc: /* Specify the coding system for read operations. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8253 It is useful to bind this variable with `let', but do not set it globally. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8254 If the value is a coding system, it is used for decoding on read operation. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8255 If not, an appropriate element is used from one of the coding system alists: |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8256 There are three such tables, `file-coding-system-alist', |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8257 `process-coding-system-alist', and `network-coding-system-alist'. */); |
| 17052 | 8258 Vcoding_system_for_read = Qnil; |
| 8259 | |
| 8260 DEFVAR_LISP ("coding-system-for-write", &Vcoding_system_for_write, | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8261 doc: /* Specify the coding system for write operations. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8262 Programs bind this variable with `let', but you should not set it globally. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8263 If the value is a coding system, it is used for encoding of output, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8264 when writing it to a file and when sending it to a file or subprocess. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8265 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8266 If this does not specify a coding system, an appropriate element |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8267 is used from one of the coding system alists: |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8268 There are three such tables, `file-coding-system-alist', |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8269 `process-coding-system-alist', and `network-coding-system-alist'. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8270 For output to files, if the above procedure does not specify a coding system, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8271 the value of `buffer-file-coding-system' is used. */); |
| 17052 | 8272 Vcoding_system_for_write = Qnil; |
| 8273 | |
| 8274 DEFVAR_LISP ("last-coding-system-used", &Vlast_coding_system_used, | |
| 88365 | 8275 doc: /* |
| 8276 Coding system used in the latest file or process I/O. */); | |
| 17052 | 8277 Vlast_coding_system_used = Qnil; |
| 8278 | |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8279 DEFVAR_BOOL ("inhibit-eol-conversion", &inhibit_eol_conversion, |
| 88365 | 8280 doc: /* |
| 8281 *Non-nil means always inhibit code conversion of end-of-line format. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8282 See info node `Coding Systems' and info node `Text and Binary' concerning |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8283 such conversion. */); |
|
18650
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8284 inhibit_eol_conversion = 0; |
|
aa3f2820e2ac
(Qemacs_mule, inhibit_eol_conversion): New variables.
Kenichi Handa <handa@m17n.org>
parents:
18613
diff
changeset
|
8285 |
|
21574
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
8286 DEFVAR_BOOL ("inherit-process-coding-system", &inherit_process_coding_system, |
| 88365 | 8287 doc: /* |
| 8288 Non-nil means process buffer inherits coding system of process output. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8289 Bind it to t if the process output is to be treated as if it were a file |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8290 read from some filesystem. */); |
|
21574
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
8291 inherit_process_coding_system = 0; |
|
30394e3ae7f8
(syms_of_coding): Declare and define inherit-process-coding-system.
Eli Zaretskii <eliz@gnu.org>
parents:
21520
diff
changeset
|
8292 |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8293 DEFVAR_LISP ("file-coding-system-alist", &Vfile_coding_system_alist, |
| 88365 | 8294 doc: /* |
| 8295 Alist to decide a coding system to use for a file I/O operation. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8296 The format is ((PATTERN . VAL) ...), |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8297 where PATTERN is a regular expression matching a file name, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8298 VAL is a coding system, a cons of coding systems, or a function symbol. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8299 If VAL is a coding system, it is used for both decoding and encoding |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8300 the file contents. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8301 If VAL is a cons of coding systems, the car part is used for decoding, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8302 and the cdr part is used for encoding. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8303 If VAL is a function symbol, the function must return a coding system |
|
41678
5aa97e545399
(syms_of_coding) <Qchar_coding_system>: Give it an
Dave Love <fx@gnu.org>
parents:
41624
diff
changeset
|
8304 or a cons of coding systems which are used as above. The function gets |
|
5aa97e545399
(syms_of_coding) <Qchar_coding_system>: Give it an
Dave Love <fx@gnu.org>
parents:
41624
diff
changeset
|
8305 the arguments with which `find-operation-coding-systems' was called. |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8306 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8307 See also the function `find-operation-coding-system' |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8308 and the variable `auto-coding-alist'. */); |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8309 Vfile_coding_system_alist = Qnil; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8310 |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8311 DEFVAR_LISP ("process-coding-system-alist", &Vprocess_coding_system_alist, |
| 88365 | 8312 doc: /* |
| 8313 Alist to decide a coding system to use for a process I/O operation. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8314 The format is ((PATTERN . VAL) ...), |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8315 where PATTERN is a regular expression matching a program name, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8316 VAL is a coding system, a cons of coding systems, or a function symbol. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8317 If VAL is a coding system, it is used for both decoding what received |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8318 from the program and encoding what sent to the program. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8319 If VAL is a cons of coding systems, the car part is used for decoding, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8320 and the cdr part is used for encoding. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8321 If VAL is a function symbol, the function must return a coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8322 or a cons of coding systems which are used as above. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8323 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8324 See also the function `find-operation-coding-system'. */); |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8325 Vprocess_coding_system_alist = Qnil; |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8326 |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8327 DEFVAR_LISP ("network-coding-system-alist", &Vnetwork_coding_system_alist, |
| 88365 | 8328 doc: /* |
| 8329 Alist to decide a coding system to use for a network I/O operation. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8330 The format is ((PATTERN . VAL) ...), |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8331 where PATTERN is a regular expression matching a network service name |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8332 or is a port number to connect to, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8333 VAL is a coding system, a cons of coding systems, or a function symbol. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8334 If VAL is a coding system, it is used for both decoding what received |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8335 from the network stream and encoding what sent to the network stream. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8336 If VAL is a cons of coding systems, the car part is used for decoding, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8337 and the cdr part is used for encoding. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8338 If VAL is a function symbol, the function must return a coding system |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8339 or a cons of coding systems which are used as above. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8340 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8341 See also the function `find-operation-coding-system'. */); |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8342 Vnetwork_coding_system_alist = Qnil; |
| 17052 | 8343 |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8344 DEFVAR_LISP ("locale-coding-system", &Vlocale_coding_system, |
|
41026
6f20449b7e12
(syms_of_coding): Doc fix.
Richard M. Stallman <rms@gnu.org>
parents:
41006
diff
changeset
|
8345 doc: /* Coding system to use with system messages. |
|
6f20449b7e12
(syms_of_coding): Doc fix.
Richard M. Stallman <rms@gnu.org>
parents:
41006
diff
changeset
|
8346 Also used for decoding keyboard input on X Window system. */); |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8347 Vlocale_coding_system = Qnil; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8348 |
|
29182
1d1c27067af4
(encode_eol): Add null statement after label.
Dave Love <fx@gnu.org>
parents:
29172
diff
changeset
|
8349 /* The eol mnemonics are reset in startup.el system-dependently. */ |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8350 DEFVAR_LISP ("eol-mnemonic-unix", &eol_mnemonic_unix, |
| 88365 | 8351 doc: /* |
| 8352 *String displayed in mode line for UNIX-like (LF) end-of-line format. */); | |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8353 eol_mnemonic_unix = build_string (":"); |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8354 |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8355 DEFVAR_LISP ("eol-mnemonic-dos", &eol_mnemonic_dos, |
| 88365 | 8356 doc: /* |
| 8357 *String displayed in mode line for DOS-like (CRLF) end-of-line format. */); | |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8358 eol_mnemonic_dos = build_string ("\\"); |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8359 |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8360 DEFVAR_LISP ("eol-mnemonic-mac", &eol_mnemonic_mac, |
| 88365 | 8361 doc: /* |
| 8362 *String displayed in mode line for MAC-like (CR) end-of-line format. */); | |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8363 eol_mnemonic_mac = build_string ("/"); |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8364 |
|
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8365 DEFVAR_LISP ("eol-mnemonic-undecided", &eol_mnemonic_undecided, |
| 88365 | 8366 doc: /* |
| 8367 *String displayed in mode line when end-of-line format is not yet determined. */); | |
|
24200
b9d9fccad516
(syms_of_coding): eol-mnemonic-* variables are now
Eli Zaretskii <eliz@gnu.org>
parents:
24178
diff
changeset
|
8368 eol_mnemonic_undecided = build_string (":"); |
| 17052 | 8369 |
|
22119
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
8370 DEFVAR_LISP ("enable-character-translation", &Venable_character_translation, |
| 88365 | 8371 doc: /* |
| 8372 *Non-nil enables character translation while encoding and decoding. */); | |
|
22119
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
8373 Venable_character_translation = Qt; |
|
592bb8b9bcfd
Change terms unify/unification to
Kenichi Handa <handa@m17n.org>
parents:
22020
diff
changeset
|
8374 |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
8375 DEFVAR_LISP ("standard-translation-table-for-decode", |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8376 &Vstandard_translation_table_for_decode, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8377 doc: /* Table for translating characters while decoding. */); |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
8378 Vstandard_translation_table_for_decode = Qnil; |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
8379 |
|
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
8380 DEFVAR_LISP ("standard-translation-table-for-encode", |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8381 &Vstandard_translation_table_for_encode, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8382 doc: /* Table for translating characters while encoding. */); |
|
22186
fc4aaf1b1772
Change term "character translation table" to "translation table".
Kenichi Handa <handa@m17n.org>
parents:
22166
diff
changeset
|
8383 Vstandard_translation_table_for_encode = Qnil; |
| 17052 | 8384 |
| 88365 | 8385 DEFVAR_LISP ("charset-revision-table", &Vcharset_revision_table, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8386 doc: /* Alist of charsets vs revision numbers. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8387 While encoding, if a charset (car part of an element) is found, |
| 88365 | 8388 designate it with the escape sequence identifying revision (cdr part |
| 8389 of the element). */); | |
| 8390 Vcharset_revision_table = Qnil; | |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8391 |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8392 DEFVAR_LISP ("default-process-coding-system", |
|
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8393 &Vdefault_process_coding_system, |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8394 doc: /* Cons of coding systems used for process I/O by default. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8395 The car part is used for decoding a process output, |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8396 the cdr part is used for encoding a text to be sent to a process. */); |
|
18180
5f4c4da24e75
(Vcoding_system_alist): Deleted.
Kenichi Handa <handa@m17n.org>
parents:
18002
diff
changeset
|
8397 Vdefault_process_coding_system = Qnil; |
|
19280
e755044718ee
(ENCODE_ISO_CHARACTER_DIMENSION1): Pay attention to
Kenichi Handa <handa@m17n.org>
parents:
19193
diff
changeset
|
8398 |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
8399 DEFVAR_LISP ("latin-extra-code-table", &Vlatin_extra_code_table, |
| 88365 | 8400 doc: /* |
| 8401 Table of extra Latin codes in the range 128..159 (inclusive). | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8402 This is a vector of length 256. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8403 If Nth element is non-nil, the existence of code N in a file |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8404 \(or output of subprocess) doesn't prevent it to be detected as |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8405 a coding system of ISO 2022 variant which has a flag |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8406 `accept-latin-extra-code' t (e.g. iso-latin-1) on reading a file |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8407 or reading output of a subprocess. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8408 Only 128th through 159th elements has a meaning. */); |
|
19365
d9374f5ebd3a
(CODING_FLAG_ISO_LATIN_EXTRA): New macro.
Kenichi Handa <handa@m17n.org>
parents:
19285
diff
changeset
|
8409 Vlatin_extra_code_table = Fmake_vector (make_number (256), Qnil); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8410 |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8411 DEFVAR_LISP ("select-safe-coding-system-function", |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8412 &Vselect_safe_coding_system_function, |
| 88365 | 8413 doc: /* |
| 8414 Function to call to select safe coding system for encoding a text. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8415 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8416 If set, this function is called to force a user to select a proper |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8417 coding system which can encode the text in the case that a default |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8418 coding system used in each operation can't encode the text. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8419 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8420 The default value is `select-safe-coding-system' (which see). */); |
|
20718
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8421 Vselect_safe_coding_system_function = Qnil; |
|
c600dea3b06b
Vselect_safe_coding_system_function): New variable.
Kenichi Handa <handa@m17n.org>
parents:
20708
diff
changeset
|
8422 |
|
30292
14a9937df1f5
(syms_of_coding): Fix typo in spelling of variable
Gerd Moellmann <gerd@gnu.org>
parents:
30263
diff
changeset
|
8423 DEFVAR_BOOL ("inhibit-iso-escape-detection", |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
8424 &inhibit_iso_escape_detection, |
| 88365 | 8425 doc: /* |
| 8426 If non-nil, Emacs ignores ISO2022's escape sequence on code detection. | |
|
40713
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8427 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8428 By default, on reading a file, Emacs tries to detect how the text is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8429 encoded. This code detection is sensitive to escape sequences. If |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8430 the sequence is valid as ISO2022, the code is determined as one of |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8431 the ISO2022 encodings, and the file is decoded by the corresponding |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8432 coding system (e.g. `iso-2022-7bit'). |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8433 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8434 However, there may be a case that you want to read escape sequences in |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8435 a file as is. In such a case, you can set this variable to non-nil. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8436 Then, as the code detection ignores any escape sequences, no file is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8437 detected as encoded in some ISO2022 encoding. The result is that all |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8438 escape sequences become visible in a buffer. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8439 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8440 The default value is nil, and it is strongly recommended not to change |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8441 it. That is because many Emacs Lisp source files that contain |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8442 non-ASCII characters are encoded by the coding system `iso-2022-7bit' |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8443 in Emacs's distribution, and they won't be decoded correctly on |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8444 reading if you suppress escape sequence detection. |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8445 |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8446 The other way to read escape sequences in a file without decoding is |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8447 to explicitly specify some coding system that doesn't use ISO2022's |
|
42351475da08
Change doc-string comments to `new style' [w/`doc:' keyword].
Pavel Jan?k <Pavel@Janik.cz>
parents:
40656
diff
changeset
|
8448 escape sequence (e.g `latin-1') on reading by \\[universal-coding-system-argument]. */); |
|
30204
35aec8514228
(inhibit_iso_escape_detection): New variable.
Kenichi Handa <handa@m17n.org>
parents:
29985
diff
changeset
|
8449 inhibit_iso_escape_detection = 0; |
|
88456
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8450 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8451 { |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8452 Lisp_Object args[coding_arg_max]; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8453 Lisp_Object plist[14]; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8454 int i; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8455 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8456 for (i = 0; i < coding_arg_max; i++) |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8457 args[i] = Qnil; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8458 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8459 plist[0] = intern (":name"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8460 plist[1] = args[coding_arg_name] = Qno_conversion; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8461 plist[2] = intern (":mnemonic"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8462 plist[3] = args[coding_arg_mnemonic] = make_number ('='); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8463 plist[4] = intern (":coding-type"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8464 plist[5] = args[coding_arg_coding_type] = Qraw_text; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8465 plist[6] = intern (":ascii-compatible-p"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8466 plist[7] = args[coding_arg_ascii_compatible_p] = Qt; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8467 plist[8] = intern (":default-char"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8468 plist[9] = args[coding_arg_default_char] = make_number (0); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8469 plist[10] = intern (":docstring"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8470 plist[11] = build_string ("Do no conversion.\n\ |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8471 \n\ |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8472 When you visit a file with this coding, the file is read into a\n\ |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8473 unibyte buffer as is, thus each byte of a file is treated as a\n\ |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8474 character."); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8475 plist[12] = intern (":eol-type"); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8476 plist[13] = args[coding_arg_eol_type] = Qunix; |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8477 args[coding_arg_plist] = Flist (14, plist); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8478 Fdefine_coding_system_internal (coding_arg_max, args); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8479 } |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8480 |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8481 setup_coding_system (Qno_conversion, &keyboard_coding); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8482 setup_coding_system (Qno_conversion, &terminal_coding); |
|
a7b309f72920
(coding_alloc_by_making_gap): Check the case that the
Kenichi Handa <handa@m17n.org>
parents:
88443
diff
changeset
|
8483 setup_coding_system (Qno_conversion, &safe_terminal_coding); |
| 17052 | 8484 } |
| 8485 | |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8486 char * |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8487 emacs_strerror (error_number) |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8488 int error_number; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8489 { |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8490 char *str; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8491 |
|
26526
b7438760079b
* callproc.c (strerror): Remove decl.
Paul Eggert <eggert@twinsun.com>
parents:
26240
diff
changeset
|
8492 synchronize_system_messages_locale (); |
|
26088
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8493 str = strerror (error_number); |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8494 |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8495 if (! NILP (Vlocale_coding_system)) |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8496 { |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8497 Lisp_Object dec = code_convert_string_norecord (build_string (str), |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8498 Vlocale_coding_system, |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8499 0); |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8500 str = (char *) XSTRING (dec)->data; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8501 } |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8502 |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8503 return str; |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8504 } |
|
b7aa6ac26872
Add support for large files, 64-bit Solaris, system locale codings.
Paul Eggert <eggert@twinsun.com>
parents:
26067
diff
changeset
|
8505 |
| 17052 | 8506 #endif /* emacs */ |
