Skip to content

Latest commit

 

History

History
307 lines (275 loc) · 26.3 KB

character-tables-bengali.md

File metadata and controls

307 lines (275 loc) · 26.3 KB

Bengali character tables

This document lists the per-character shaping information needed to shape Bengali text.

Table of Contents

Bengali character table

Bengali glyphs should be classified as in the following table. Codepoints in the Bengali block with no assigned meaning are designated as unassigned in the Unicode category column.

Assigned codepoints with a null in the Shaping class column evoke no special behavior from the shaping engine. Note that this does include some valid codepoints, such as currency marks, punctuation, and other symbols.

Note: the NUMBER and SYMBOL Shaping classes are important during syllable identification, but generally evoke no further special behavior during the rest of the shaping process.

The Mark-placement subclass column indicates mark-placement positioning for codepoints in the Mark category. Assigned, non-mark codepoints have a null in this column and evoke no special mark-placement behavior. Marks tagged with [Mn] in the Unicode category column are categorized as non-spacing; marks tagged with [Mc] are categorized as spacing-combining.

Some codepoints in the following table use a Shaping class that differs from the codepoint's Unicode General Category. The Shaping class takes precedence during OpenType shaping, as it captures more specific, script-aware behavior.

Codepoint Unicode category Shaping class Mark-placement subclass Glyph
U+0980 Letter CONSONANT_PLACEHOLDER null ঀ Anji
U+0981 Mark [Mn] BINDU TOP_POSITION ঁ Candrabindu
U+0982 Mark [Mc] BINDU RIGHT_POSITION ং Anusvara
U+0983 Mark [Mc] VISARGA RIGHT_POSITION ঃ Visarga
U+0984 unassigned
U+0985 Letter VOWEL_INDEPENDENT null অ A
U+0986 Letter VOWEL_INDEPENDENT null আ Aa
U+0987 Letter VOWEL_INDEPENDENT null ই I
U+0988 Letter VOWEL_INDEPENDENT null ঈ Ii
U+0989 Letter VOWEL_INDEPENDENT null উ U
U+098A Letter VOWEL_INDEPENDENT null ঊ Uu
U+098B Letter VOWEL_INDEPENDENT null ঋ Vocalic R
U+098C Letter VOWEL_INDEPENDENT null ঌ Vocalic L
U+098D unassigned
U+098E unassigned
U+098F Letter VOWEL_INDEPENDENT null এ E
U+0990 Letter VOWEL_INDEPENDENT null ঐ Ai
U+0991 unassigned
U+0992 unassigned
U+0993 Letter VOWEL_INDEPENDENT null ও O
U+0994 Letter VOWEL_INDEPENDENT null ঔ Au
U+0995 Letter CONSONANT null ক Ka
U+0996 Letter CONSONANT null খ Kha
U+0997 Letter CONSONANT null গ Ga
U+0998 Letter CONSONANT null ঘ Gha
U+0999 Letter CONSONANT null ঙ Nga
U+099A Letter CONSONANT null চ Ca
U+099B Letter CONSONANT null ছ Cha
U+099C Letter CONSONANT null জ Ja
U+099D Letter CONSONANT null ঝ Jha
U+099E Letter CONSONANT null ঞ Nya
U+099F Letter CONSONANT null ট Tta
U+09A0 Letter CONSONANT null ঠ Ttha
U+09A1 Letter CONSONANT null ড Dda
U+09A2 Letter CONSONANT null ঢ Ddha
U+09A3 Letter CONSONANT null ণ Nna
U+09A4 Letter CONSONANT null ত Ta
U+09A5 Letter CONSONANT null থ Tha
U+09A6 Letter CONSONANT null দ Da
U+09A7 Letter CONSONANT null ধ Dha
U+09A8 Letter CONSONANT null ন Na
U+09A9 unassigned
U+09AA Letter CONSONANT null প Pa
U+09AB Letter CONSONANT null ফ Pha
U+09AC Letter CONSONANT null ব Ba
U+09AD Letter CONSONANT null ভ Bha
U+09AE Letter CONSONANT null ম Ma
U+09AF Letter CONSONANT null য Ya
U+09B0 Letter CONSONANT null র Ra
U+09B1 unassigned
U+09B2 Letter CONSONANT null ল La
U+09B3 unassigned
U+09B4 unassigned
U+09B5 unassigned
U+09B6 Letter CONSONANT null শ Sha
U+09B7 Letter CONSONANT null ষ Ssa
U+09B8 Letter CONSONANT null স Sa
U+09B9 Letter CONSONANT null হ Ha
U+09BA unassigned
U+09BB unassigned
U+09BC Mark [Mn] NUKTA BOTTOM_POSITION ় Nukta
U+09BD Letter AVAGRAHA null ঽ Avagraha
U+09BE Mark [Mc] VOWEL_DEPENDENT RIGHT_POSITION া Sign Aa
U+09BF Mark [Mc] VOWEL_DEPENDENT LEFT_POSITION ি Sign I
U+09C0 Mark [Mc] VOWEL_DEPENDENT RIGHT_POSITION ী Sign Ii
U+09C1 Mark [Mn] VOWEL_DEPENDENT BOTTOM_POSITION ু Sign U
U+09C2 Mark [Mn] VOWEL_DEPENDENT BOTTOM_POSITION ূ Sign Uu
U+09C3 Mark [Mn] VOWEL_DEPENDENT BOTTOM_POSITION ৃ Sign Vocalic R
U+09C4 Mark [Mn] VOWEL_DEPENDENT BOTTOM_POSITION ৄ Sign Vocalic Rr
U+09C5 unassigned
U+09C6 unassigned
U+09C7 Mark [Mc] VOWEL_DEPENDENT LEFT_POSITION ে Sign E
U+09C8 Mark [Mc] VOWEL_DEPENDENT LEFT_POSITION ৈ Sign Ai
U+09C9 unassigned
U+09CA unassigned
U+09CB Mark [Mc] VOWEL_DEPENDENT LEFT_AND_RIGHT_POSITION ো Sign O
U+09CC Mark [Mc] VOWEL_DEPENDENT LEFT_AND_RIGHT_POSITION ৌ Sign Au
U+09CD Mark [Mn] VIRAMA BOTTOM_POSITION ্ Virama
U+09CE Letter CONSONANT_DEAD null ৎ Khanda Ta
U+09CF unassigned
U+09D0 unassigned
U+09D1 unassigned
U+09D2 unassigned
U+09D3 unassigned
U+09D4 unassigned
U+09D5 unassigned
U+09D6 unassigned
U+09D7 Mark [Mc] VOWEL_DEPENDENT RIGHT_POSITION ৗ Au Length Mark
U+09D8 unassigned
U+09D9 unassigned
U+09DA unassigned
U+09DB unassigned
U+09DC Letter CONSONANT null ড় Rra
U+09DD Letter CONSONANT null ঢ় Rha
U+09DE unassigned
U+09DF Letter CONSONANT null য় Yya
U+09E0 Letter VOWEL_INDEPENDENT null ৠ Vocalic Rr
U+09E1 Letter VOWEL_INDEPENDENT null ৡ Vocalic Ll
U+09E2 Mark [Mn] VOWEL_DEPENDENT BOTTOM_POSITION ৢ Sign Vocalic L
U+09E3 Mark [Mn] VOWEL_DEPENDENT BOTTOM_POSITION ৣ Sign Vocalic Ll
U+09E4 unassigned
U+09E5 unassigned
U+09E6 Number NUMBER null ০ Digit Zero
U+09E7 Number NUMBER null ১ Digit One
U+09E8 Number NUMBER null ২ Digit Two
U+09E9 Number NUMBER null ৩ Digit Three
U+09EA Number NUMBER null ৪ Digit Four
U+09EB Number NUMBER null ৫ Digit Five
U+09EC Number NUMBER null ৬ Digit Six
U+09ED Number NUMBER null ৭ Digit Seven
U+09EE Number NUMBER null ৮ Digit Eight
U+09EF Number NUMBER null ৯ Digit Nine
U+09F0 Letter CONSONANT null ৰ Assamese Ra
U+09F1 Letter CONSONANT null ৱ Assamese Wa
U+09F2 Symbol SYMBOL null ৲ Rupee Mark
U+09F3 Symbol SYMBOL null ৳ Rupee Sign
U+09F4 Number NUMBER null ৴ Numerator One
U+09F5 Number NUMBER null ৵ Numerator Two
U+09F6 Number NUMBER null ৶ Numerator Three
U+09F7 Number NUMBER null ৷ Numerator Four
U+09F8 Number NUMBER null ৸ Numerator One Less Than Denominator
U+09F9 Number NUMBER null ৹ Denominator Sixteen
U+09FA Symbol SYMBOL null ৺ Isshar
U+09FB Symbol SYMBOL null ৻ Ganda Mark
U+09FC Letter null null ৼ Vedic Anusvara
U+09FD Punctuation null null ৽ Abbreviation Sign
U+09FE Mark [Mn] SYLLABLE_MODIFIER TOP_POSITION ৾ Sandhi Mark
U+09FF unassigned

Vedic Extensions character table

Sanskrit runs written in the Bengali script may also include characters from the Vedic Extensions block. These characters should be classified as follows.

Note: See the Vedic Extensions document for additional information.

Codepoint Unicode category Shaping class Mark-placement subclass Glyph
U+1CD0 Mark [Mn] CANTILLATION TOP_POSITION ᳐ Tone Karshana
U+1CD1 Mark [Mn] CANTILLATION TOP_POSITION ᳑ Tone Shara
U+1CD2 Mark [Mn] CANTILLATION TOP_POSITION ᳒ Tone Prenkha
U+1CD3 Punctuation null null ᳓ Sign Nihshvasa
U+1CD4 Mark [Mn] CANTILLATION OVERSTRUCK ᳔ Tone Midline Svarita
U+1CD5 Mark [Mn] CANTILLATION BOTTOM_POSITION ᳕ Tone Aggravated Independent Svarita
U+1CD6 Mark [Mn] CANTILLATION BOTTOM_POSITION ᳖ Tone Independent Svarita
U+1CD7 Mark [Mn] CANTILLATION BOTTOM_POSITION ᳗ Tone Kathaka Independent Svarita
U+1CD8 Mark [Mn] CANTILLATION BOTTOM_POSITION ᳘ Tone Candra Below
U+1CD9 Mark [Mn] CANTILLATION BOTTOM_POSITION ᳙ Tone Kathaka Independent Svarita Schroeder
U+1CDA Mark [Mn] CANTILLATION TOP_POSITION ᳚ Tone Double Svarita
U+1CDB Mark [Mn] CANTILLATION TOP_POSITION ᳛ Tone Triple Svarita
U+1CDC Mark [Mn] CANTILLATION BOTTOM_POSITION ᳜ Tone Kathaka Anudatta
U+1CDD Mark [Mn] CANTILLATION BOTTOM_POSITION ᳝ Tone Dot Below
U+1CDE Mark [Mn] CANTILLATION BOTTOM_POSITION ᳞ Tone Two Dots Below
U+1CDF Mark [Mn] CANTILLATION BOTTOM_POSITION ᳟ Tone Three Dots Below
U+1CE0 Mark [Mn] CANTILLATION TOP_POSITION ᳠ Tone Rigvedic Kashmiri Independent Svarita
U+1CE1 Mark [Mc] CANTILLATION RIGHT_POSITION ᳡ Tone Atharavedic Independent Svarita
U+1CE2 Mark [Mn] AVAGRAHA OVERSTRUCK ᳢ Sign Visarga Svarita
U+1CE3 Mark [Mn] null OVERSTRUCK ᳣ Sign Visarga Udatta
U+1CE4 Mark [Mn] null OVERSTRUCK ᳤ Sign Reversed Visarga Udatta
U+1CE5 Mark [Mn] null OVERSTRUCK ᳥ Sign Visarga Anudatta
U+1CE6 Mark [Mn] null OVERSTRUCK ᳦ Sign Reversed Visarga Anudatta
U+1CE7 Mark [Mn] null OVERSTRUCK ᳧ Sign Visarga Udatta With Tail
U+1CE8 Mark [Mn] AVAGRAHA OVERSTRUCK ᳨ Sign Visarga Anudatta With Tail
U+1CE9 Letter SYMBOL null ᳩ Sign Anusvara Antargomukha
U+1CEA Letter null null ᳪ Sign Anusvara Bahirgomukha
U+1CEB Letter null null ᳫ Sign Anusvara Vamagomukha
U+1CEC Letter SYMBOL null ᳬ Sign Anusvara Vamagomukha With Tail
U+1CED Mark [Mn] AVAGRAHA BOTTOM_POSITION ᳭ Sign Tiryak
U+1CEE Letter SYMBOL null ᳮ Sign Hexiform Long Anusvara
U+1CEF Letter null null ᳯ Sign Long Anusvara
U+1CF0 Letter null null ᳰ Sign Rthang Long Anusvara
U+1CF2 Letter CONSONANT_DEAD null ᳲ Sign Ardhavisarga
U+1CF3 Letter CONSONANT_DEAD null ᳳ Sign Rotated Ardhavisarga
U+1CF3 Mark [Mc] VISARGA null ᳳ Sign Rotated Ardhavisarga
U+1CF4 Mark [Mn] CANTILLATION TOP_POSITION ᳴ Tone Candra Above
U+1CF5 Letter CONSONANT_WITH_STACKER null ᳵ Sign Jihvamuliya
U+1CF6 Letter CONSONANT_WITH_STACKER null ᳶ Sign Upadhmaniya
U+1CF7 Mark [Mc] null null ᳷ Sign Atikrama
U+1CF8 Mark [Mn] CANTILLATION null ᳸ Tone Ring Above
U+1CF9 Mark [Mn] CANTILLATION null ᳹ Tone Double Ring Above
U+1CFA Letter PLACEHOLDER null ᳺ Sign Double Anusvara Antargomukha
U+1CFB unassigned
U+1CFC unassigned
U+1CFD unassigned
U+1CFE unassigned
U+1CFF unassigned

Miscellaneous character table

In addition to general punctuation, runs of Bengali text often use the danda (U+0964) and double danda (U+0965) punctuation marks from the Devanagari block. Bengali text can also incorporate the udatta (U+0951) and anudatta (U+0952) signs from the Devanagari block.

Codepoint Unicode category Shaping class Mark-placement subclass Glyph
U+0951 Mark [Mn] CANTILLATION TOP_POSITION ॑ Udatta
U+0952 Mark [Mn] CANTILLATION BOTTOM_POSITION ॒ Anudatta
U+0964 Punctuation null null । Danda
U+0965 Punctuation null null ॥ Double Danda

Other important characters that may be encountered when shaping runs of Bengali text include the dotted-circle placeholder (U+25CC), the zero-width joiner (U+200D) and zero-width non-joiner (U+200C), and the no-break space (U+00A0).

The dotted-circle placeholder is frequently used when displaying a dependent vowel (matra) or a combining mark in isolation. Real-world text syllables may also use other characters, such as hyphens or dashes, in a similar placeholder fashion; shaping engines should cope with this situation gracefully.

Codepoint Unicode category Shaping class Mark-placement subclass Glyph
U+00A0 Separator PLACEHOLDER null   No-break space
U+200C Other NON_JOINER null ‌ Zero-width non-joiner
U+200D Other JOINER null ‍ Zero-width joiner
U+2010 Punctuation PLACEHOLDER null ‐ Hyphen
U+2011 Punctuation PLACEHOLDER null ‑ No-break hyphen
U+2012 Punctuation PLACEHOLDER null ‒ Figure dash
U+2013 Punctuation PLACEHOLDER null – En dash
U+2014 Punctuation PLACEHOLDER null — Em dash
U+25CC Symbol DOTTED_CIRCLE null ◌ Dotted circle

The zero-width joiner (ZWJ) is primarily used to prevent the formation of a conjunct from a "Consonant,Halant,Consonant" sequence. The sequence "Consonant,Halant,ZWJ,Consonant" blocks the formation of a conjunct between the two consonants.

Note, however, that the "Consonant,Halant" subsequence in the above example may still trigger a half-forms feature. To prevent the application of the half-forms feature in addition to preventing the conjunct, the zero-width non-joiner (ZWNJ) must be used instead. The sequence "Consonant,Halant,ZWNJ,Consonant" should produce the first consonant in its standard form, followed by an explicit "Halant".

A secondary usage of the zero-width joiner is to prevent the formation of "Reph". An initial "Ra,Halant,ZWJ" sequence should not produce a "Reph", where an initial "Ra,Halant" sequence without the zero-width joiner otherwise would.

The no-break space (NBSP) is primarily used to display those codepoints that are defined as non-spacing (marks, dependent vowels (matras), below-base consonant forms, and post-base consonant forms) in an isolated context, as an alternative to displaying them superimposed on the dotted-circle placeholder. These sequences will match "NBSP,ZWJ,Halant,Consonant", "NBSP,mark", or "NBSP,matra".