Windows code page

Windows code pages are sets of characters or code pages (known as character encodings in other operating systems) used in Microsoft Windows from the 1980s and 1990s. Windows code pages were gradually superseded when Unicode was implemented in Windows, although they are still supported both within Windows and other platforms.

There are two groups of code pages in Windows systems: OEM and ANSI code pages. Code pages in both of these groups are extended ASCII code pages.

ANSI code page

ANSI code pages (officially called "Windows code pages"[1] after Microsoft accepted the former term being a misnomer[2]) are used for native non-Unicode (say, byte oriented) applications using a graphical user interface on Windows systems. ANSI Windows code pages, and especially the code page 1252, were called that way since they were purportedly based on drafts submitted or intended for ANSI. However, ANSI and ISO have not standardized any of these code pages. Instead they are either supersets of the standard sets such as those of ISO 8859 and the various national standards (like Windows-1252 vs. ISO-8859-1), major modifications of these (making them incompatible to various degrees, like Windows-1250 vs. ISO-8859-2) or having no parallel encoding (like Windows-1257 vs. ISO-8859-4; ISO-8859-13 was introduced much later).[2] About twelve of the typography and business characters from CP1252 at code points 0x80–0x9F (in ISO 8859 occupied by C1 control codes, which are useless in Windows) are present in many other ANSI/Windows code pages at the same codes. These code pages are labelled by Internet Assigned Numbers Authority (IANA) as "Windows-number".[3]

OEM code page

The OEM code pages (original equipment manufacturer) are used by Win32 console applications, and by virtual DOS, and can be considered a holdover from DOS and the original IBM PC architecture. A separate suite of code pages was implemented not only due to compatibility, but also because the fonts of VGA (and descendant) hardware suggest encoding of line drawing characters to be compatible with code page 437. Most OEM code pages share many code points, particularly for non-letter characters, with the second (non-ASCII) half of CP437.

A typical OEM code page, in its second half, does not resemble any ANSI/Windows code page even roughly. Nevertheless, two single-byte, fixed-width code pages (874 for Thai and 1258 for Vietnamese) and four multibyte CJK code pages (932, 936, 949, 950) are used as both OEM and ANSI code pages. Code page 1258 uses combining diacritics, as Vietnamese requires more than 128 letter-diacritic combinations. This is in contrast to VISCII, which replaces some of the C0 (i.e. ASCII) control codes.

History

Initially, computer systems and system programming languages did not make a distinction between characters and bytes. This led to much confusion subsequently. Microsoft software and systems previous to the Windows NT line are examples of this, using the OEM and ANSI code pages, which do not make the distinction.

Since the late 1990s, software and systems are increasingly adopting more direct encodings of Unicode, in particular UTF-8 and UTF-16; this trend has been improved by the widespread adoption of XML, which provides a more adequate mechanism for labelling the encoding used.[4] Recent Microsoft products and application program interfaces use Unicode internally, but many applications and APIs continue to use the default encoding of the computer's locale when reading and writing text data to files or standard output. Therefore, though Unicode is the accepted standard, there is still backwards compatibility with the older Windows code pages.

The euro sign was added relatively recently to ANSI and OEM code pages (1998 in the case of Code page 858) and therefore obsolete versions of Windows are unable to use it with code pages.

List

This list is incomplete; you can help by expanding it.

The following Windows code pages exist:

ID Names Description Type Base Encoding Standard Support DOS- based Windows Support Windows NT family Support Windows CE family Comments
37 CP037, IBM037 IBM EBCDIC US-Canada Other EBCDIC derivation 8-bit SBCS IBM CP037[5] ? Yes
437 CP437, IBM437 IBM PC US OEM ASCII derivation 8-bit SBCS IBM CP437[6] 1.00-4.90 Yes
1250 CP1250, Windows-1250 Latin 2 / Central European ANSI ASCII derivation 8-bit SBCS Microsoft CP1250[7][8] ? Yes
1251 CP1251, Windows-1251 Cyrillic ANSI ASCII derivation 8-bit SBCS Microsoft CP1251[9][10] ? Yes
1252 CP1252, Windows-1252 Latin 1 / Western European ANSI ASCII derivation 8-bit SBCS Microsoft CP1252[11][12] ? Yes letter repertoire similar to CP850
1253 CP1253, Windows-1253 Greek ANSI ASCII derivation 8-bit SBCS Microsoft CP1253[13][14] ? Yes
1254 CP1254, Windows-1254 Turkish ANSI ASCII derivation 8-bit SBCS Microsoft CP1254[15][16] ? Yes
1255 CP1255, Windows-1255 Hebrew ANSI ASCII derivation 8-bit SBCS Microsoft CP1255[17][18] ? Yes
1256 CP1256, Windows-1256 Arabic ANSI ASCII derivation 8-bit SBCS Microsoft CP1256[19][20] ? Yes
1257 CP1257, Windows-1257 Baltic ANSI ASCII derivation 8-bit SBCS Microsoft CP1257[21][22] ? Yes
1258 CP1258, Windows-1258 Vietnamese OEM+ANSI ? 8-bit SBCS Microsoft CP1258[23][24] ? Yes

Problems arising from the use of code pages

Microsoft strongly recommends using Unicode in modern applications, but many applications or data files still depend on the legacy code pages.

See also

References

  1. ↑ Code Pages, MSDN
  2. ↑ 2.0 2.1 MSDN: Glossary of Terms
  3. ↑ IANA list of Character Sets
  4. ↑ http://www.w3.org/TR/xml11/#charencoding
  5. ↑ IBM. "SBCS code page information document - CPGID 00037". Retrieved 2014-07-04.
  6. ↑ IBM. "SBCS code page information document - CPGID 00437". Retrieved 2014-07-04.
  7. ↑ Microsoft. "Windows 1250". Retrieved 2014-07-06.
  8. ↑ IBM. "SBCS code page information document CPGID 01250". Retrieved 2014-07-06.
  9. ↑ Microsoft. "Windows 1251". Retrieved 2014-07-06.
  10. ↑ IBM. "SBCS code page information document CPGID 01251". Retrieved 2014-07-06.
  11. ↑ Microsoft. "Windows 1252". Retrieved 2014-07-06.
  12. ↑ IBM. "SBCS code page information document CPGID 01252". Retrieved 2014-07-06.
  13. ↑ Microsoft. "Windows 1253". Retrieved 2014-07-06.
  14. ↑ IBM. "SBCS code page information document CPGID 01253". Retrieved 2014-07-06.
  15. ↑ Microsoft. "Windows 1254". Retrieved 2014-07-06.
  16. ↑ IBM. "SBCS code page information document CPGID 01254". Retrieved 2014-07-06.
  17. ↑ Microsoft. "Windows 1255". Retrieved 2014-07-06.
  18. ↑ IBM. "SBCS code page information document CPGID 01255". Retrieved 2014-07-06.
  19. ↑ Microsoft. "Windows 1256". Retrieved 2014-07-06.
  20. ↑ IBM. "SBCS code page information document CPGID 01256". Retrieved 2014-07-06.
  21. ↑ Microsoft. "Windows 1257". Retrieved 2014-07-06.
  22. ↑ IBM. "SBCS code page information document CPGID 01257". Retrieved 2014-07-06.
  23. ↑ Microsoft. "Windows 1258". Retrieved 2014-07-06.
  24. ↑ IBM. "SBCS code page information document CPGID 01258". Retrieved 2014-07-06.
  25. ↑ Code page identifier list

External links