使用 UTF-8 时应该使用 wchar_t 吗?

2021-12-26 00:00:00 unicode utf-8 c++

UTF-8 可以编码为 1、2 和最多 4 个字节.我的系统上的单个 char 是 1 个字节.我是否应该使用 wchar_t 作为预防措施,以便我能够适应任何任意的 UTF-8 编码字符?

UTF-8 can encode in 1, 2, and up to 4 bytes. A single char on my system is 1 byte. Should I use wchar_t as a precaution so that I will be able to fit any arbitrary UTF-8 encoded character?

推荐答案

不,你不应该!Unicode 4.0 标准 (ISO 10646:2003) 指出:

No, you should not! The Unicode 4.0 standard (ISO 10646:2003) notes that:

wchar_t 的宽度是特定于编译器的,可以小到 8 位.因此,需要跨任何 C 或 C++ 编译器移植的程序不应使用 wchar_t 来存储 Unicode 文本.

The width of wchar_t is compiler-specific and can be as small as 8 bits. Consequently, programs that need to be portable across any C or C++ compiler should not use wchar_t for storing Unicode text.

在大多数情况下,UTF-8 文本的字符性质"与您的程序无关,因此将其视为 char 元素的数组,就像任何其他字符串一样,将是充足的.但是,如果您需要提取单个字符,这些字符应以至少 24 位宽的类型存储(例如,uint32_t),以便容纳所有 Unicode 代码点.

Under most circumstances, the "character nature" of UTF-8 text will not be relevant to your program, so treating it as an array of char elements, just like any other string, will be sufficient. If you need to extract individual characters, though, those characters should be stored in a type that is at least 24 bits wide (e.g, uint32_t), in order to accomodate all Unicode code points.

相关文章