[KongchangAI]
ConceptUTF-8 / 字符编码

Unicode

Unicode is the universal character encoding standard for modern computing, with UTF-8 as its most widely used encoding form. It supports characters from all major world languages and has become the standard character encoding scheme for modern terminal environments.

Core Facts

Timeline (last 90 days)

Oct 12

Characters outside the Basic Multilingual Plane (such as most emoji) become surrogate pairs consisting of two escape sequences when processed by ensure_ascii escaping.

Unverified50%
Sep 18

Typical techniques for linguistic illegibility attacks include replacing sensitive vocabulary with Unicode variant characters, mixing multiple languages, using low-resource languages to bypass filters, and fragmenting harmful intent across multiple conversation turns.

Unverified50%
Sep 12

The underlying text content in web pages and documents remains standard Unicode character encoding; fonts only determine the visual rendering of characters, not their storage.

Unverified50%
Sep 11

ASCII smuggling leverages special characters in the Unicode character set, including zero-width characters, control characters, and Unicode tag characters (in the range U+E0000 to U+E007F).

Unverified50%
Sep 11

Defending against ASCII smuggling requires anomalous Unicode character detection, character normalization processing, and the stripping of invisible characters and tag characters at the email gateway level.

Unverified50%
Sep 11

These invisible characters are not displayed in most email clients but exist in the byte stream of the text.

Unverified50%
Sep 2

The family emoji "👨‍👩‍👧‍👦" is composed of 7 Unicode code points, namely four person emojis connected in series by three zero-width joiners (U+200D).

Unverified50%
Sep 2

The URL specification RFC 3986 stipulates that only a subset of ASCII characters is allowed in URLs, and non-ASCII characters must be percent-encoded to be used legally.

Unverified50%
Aug 30

Modern terminal emulators support 256 colors or even 24-bit true color, combined with the Unicode extended character set

Unverified50%
Aug 27

零宽字符是Unicode标准中一组特殊控制字符,包括零宽空格(U+200B)、零宽连接符(U+200D)、零宽非连接符(U+200C)、左至右标记(U+200E)等,视觉上完全不可见但在字节层面真实存在

Unverified50%

3 more timeline events

All Facts (14)

Verified

Unicode defines multiple zero-width characters, such as U+200B (zero-width space), U+200C (zero-width non-joiner), U+200D (zero-width joiner), and U+FEFF (zero-width no-break space)

80%
Verified

As of its latest version, Unicode has included more than 150,000 characters.

65%
Unverified

GB2312标准收录6,763个汉字,Unicode中的CJK统一表意文字超过9万个

90%
Unverified

Characters outside the Basic Multilingual Plane (such as most emoji) become surrogate pairs consisting of two escape sequences when processed by ensure_ascii escaping.

50%
Unverified

Typical techniques for linguistic illegibility attacks include replacing sensitive vocabulary with Unicode variant characters, mixing multiple languages, using low-resource languages to bypass filters, and fragmenting harmful intent across multiple conversation turns.

50%
Unverified

The underlying text content in web pages and documents remains standard Unicode character encoding; fonts only determine the visual rendering of characters, not their storage.

50%
Unverified

ASCII smuggling leverages special characters in the Unicode character set, including zero-width characters, control characters, and Unicode tag characters (in the range U+E0000 to U+E007F).

50%
Unverified

These invisible characters are not displayed in most email clients but exist in the byte stream of the text.

50%
Unverified

Defending against ASCII smuggling requires anomalous Unicode character detection, character normalization processing, and the stripping of invisible characters and tag characters at the email gateway level.

50%
Unverified

The family emoji "👨‍👩‍👧‍👦" is composed of 7 Unicode code points, namely four person emojis connected in series by three zero-width joiners (U+200D).

50%
Unverified

The URL specification RFC 3986 stipulates that only a subset of ASCII characters is allowed in URLs, and non-ASCII characters must be percent-encoded to be used legally.

50%
Unverified

Modern terminal emulators support 256 colors or even 24-bit true color, combined with the Unicode extended character set

50%
Unverified

零宽字符是Unicode标准中一组特殊控制字符,包括零宽空格(U+200B)、零宽连接符(U+200D)、零宽非连接符(U+200C)、左至右标记(U+200E)等,视觉上完全不可见但在字节层面真实存在

50%
Unverified

Trojan Source攻击利用Unicode双向文本控制字符(如RLO等),使代码在编辑器显示与编译器解析时呈现不同逻辑,从而植入难以察觉的后门

50%

Source Articles

Reading or Guessing? Urdu Font-Twin Benchmark Reveals the Truth About Multimodal OCROct 12
终端技术全栈深度解析:从字符编码到GPU渲染Jul 12