Module:Unicode data/scripts/doc

From The Languages of David J. Peterson
Revision as of 13:48, 25 August 2024 by Juelos (talk | contribs) (Changed links to point to Wiktionary)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

This module was generated by a series of functions in Module:User:Erutuon/script recognition from the script patterns in Module:scripts/data. It is used by the char_to_script function in Module:Unicode data. It will have to be regenerated when script patterns are added or modified.

The highlight_dump and modified_dump functions in Module:debug were used to print the output from Module:User:Erutuon/script recognition.

To explain the format, the first keys are the groups of 4096 codepoints (0x1000 in hexadecimal base). Key 0 is for the first group of 4096 codepoints, from U+000 to U+FFF. Within the tables for each block of codepoints, the syntax { 0x41, 0x5A, "Latn" } indicates that all the characters from codepoint 0x41 (U+0041 or the character A) to codepoint 0x5A (U+005A or the character Z) belong to the Latin script. The table "individual" contains all the individual codepoints that are defined as belonging to a script, but are not found inside a range.

Beware: despite being listed under Module:Unicode data, this was generated from Wiktionary script classes. For the official script properties of Unicode codepoints, go to Module:Unicode data/scripts on Wikipedia.

Conflicts between character sets of different scripts

This module includes fewer scripts than Module:scripts/data, because some scripts do not have characters at all, and some scripts' character sets are in conflict with each other. Here are the ways conflicts have been resolved.

Scripts are omitted if they have the same characters as another more basic script, or they consist of two or more other scripts. For example, fa-Arab is omitted because it contains the same characters as Arab, and Jpan is omitted because it consists of Hani, Hira and Kana.

If a script consists of the characters of another script, plus some unique characters, only the unique characters are counted as belonging to the script. For instance, polytonic consists of the characters of Grek, which are used in the monotonic orthography of Modern Greek, plus characters used for Ancient Greek; only the Ancient Greek characters are counted as polytonic in this module. It is the same with Cyrs and Cyrl, Latinx and Latn.