UTF-8 is an ASCII-preserving encoding method for
Unicode (ISO 10646), the Universal Character Set
(UCS). The UCS encodes most of the world's writing systems in a single
character set, allowing you to mix languages and scripts within a document
without needing any tricks for switching character sets. This web page is
encoded directly in UTF-8.
As shown HERE,
Columbia University's Kermit 95 terminal emulation
software can display UTF-8 plain text in Windows 95, 98, ME, NT, XP, or 2000
when using a monospace Unicode font like Andale Mono WT J or Everson Mono Terminal, or the lesser
populated Courier New, Lucida Console, or Andale Mono. C-Kermit can handle it too,
if you have a Unicode
display. As many languages as are representable in your font can be seen
on the screen at the same time.
This, however, is a Web page. Some Web browsers can handle UTF-8, some can't.
And those that can might not have a sufficiently populated font to work with
(some browsers might pick glyphs dynamically from multiple fonts; Netscape 6
seems to do this).
CLICK HERE
for a survey of Unicode fonts for Windows.
The subtitle above shows currency symbols of many lands. If they don't
appear as blobs, we're off to a good start!
From Laȝamon'sBrut
(The Chronicles of England, Middle English, West Midlands):
An preost wes on leoden, Laȝamon was ihoten
He wes Leovenaðes sone -- liðe him be Drihten.
He wonede at Ernleȝe at æðelen are chirechen,
Uppen Sevarne staþe, sel þar him þuhte,
Onfest Radestone, þer he bock radde.
(The third letter in the author's name is Yogh, missing from many fonts;
CLICK HERE for another Middle English sample
with some explanation of letters and encoding).
Sîne klâwen durh die wolken sint geslagen,
er stîget ûf mit grôzer kraft,
ich sih in grâwen tägelîch als er wil tagen,
den tac, der im geselleschaft
erwenden wil, dem werden man,
den ich mit sorgen în verliez.
ich bringe in hinnen, ob ich kan.
sîn vil manegiu tugent michz leisten hiez.
Τη γλώσσα μου έδωσαν ελληνική
το σπίτι φτωχικό στις αμμουδιές του Ομήρου.
Μονάχη έγνοια η γλώσσα μου στις αμμουδιές του Ομήρου.
από το Άξιον Εστί
του Οδυσσέα Ελύτη
The first stanza of
Pushkin's Bronze Horseman (Russian):
На берегу пустынных волн
Стоял он, дум великих полн,
И вдаль глядел. Пред ним широко
Река неслася; бедный чёлн
По ней стремился одиноко.
По мшистым, топким берегам
Чернели избы здесь и там,
Приют убогого чухонца;
И лес, неведомый лучам
В тумане спрятанного солнца,
Кругом шумел.
Šota Rustaveli's Veṗxis Ṭq̇aosani,
̣︡Th, The Knight in the Tiger's Skin (Georgian):
ვეპხის ტყაოსანი
შოთა რუსთაველი
ღმერთსი შემვედრე, ნუთუ კვლა დამხსნას სოფლისა შრომასა,
ცეცხლს, წყალსა და მიწასა, ჰაერთა თანა მრომასა;
მომცნეს ფრთენი და აღვფრინდე, მივჰხვდე მას ჩემსა ნდომასა,
დღისით და ღამით ვჰხედვიდე მზისა ელვათა კრთომაასა.
Tamil poetry of Cupiramaniya Paarathiyar,
சுப்ரமணிய பாரதியார் (1882-1921):
யாமறிந்த மொழிகளிலே தமிழ்மொழி போல் இனிதாவது எங்கும் காணோம்,
பாமரராய் விலங்குகளாய், உலகனைத்தும் இகழ்ச்சிசொலப் பான்மை கெட்டு,
நாமமது தமிழரெனக் கொண்டு இங்கு வாழ்ந்திடுதல் நன்றோ? சொல்லீர்!
The "I can eat glass" phrase and initial translations (about 30 of them)
were borrowed from Ethan Mollick's I Can Eat Glass page
(which disappeared on or about June 2004) and converted to UTF-8. Since
Ethan's original page is gone, I should mention that his purpose was to offer
travelers a phrase they could use in any country that would command a
certain kind of respect, or at least get attention. See Credits for the many additional contributions since
then. When submitting new entries, the word "hurt" (if you have a choice)
is used in the sense of "cause harm", "do damage", or "bother", rather than
"inflict pain" or "make sad". In this vein Otto Stolz comments (as do
others further down; personally I think it's better for the purpose of this
page to have extra entries and/or to show a greater repertoire of characters
than it is to enforce a strict interpretation of the word "hurt"!):
The numbering of the samples is arbitrary, done only to keep track of how
many there are, and can change any time a new entry is added. The
arrangement is also arbitrary but with some attempt to group related
examples together. Note: All languages not listed are wanted, not just the
ones that say (NEEDED).
Yoruba: The third word is Latin letter small 'j' followed by
small 'e' with U+0329, Combining Vertical Line Below. This displays
correctly only if your Unicode font includes the U+0329 glyph and your
browser supports combining diacritical marks. The Indic examples
also include combining sequences.
Includes Unicode 3.1 (or later) characters beyond Plane 0.
The Classic Mongolian example should be vertical, top-to-bottom and
left-to-right. But such display is almost impossible. Also no font yet
exists which provides the proper ligatures and positional variants for the
characters of this script, which works somewhat like Arabic.
Taiwanese is also known as Holo or Hoklo, and is related to Southern
Min dialects such as Amoy.
Contributed by Henry H. Tan-Tenn, who comments, "The above is
the romanized version, in a script current among Taiwanese Christians since
the mid-19th century. It was invented by British missionaries and saw use in
hundreds of published works, mostly of a religious nature. Most Taiwanese did
not know Chinese characters then, or at least not well enough to read. More
to the point, though, a written standard using Chinese characters has never
developed, so a significant minority of words are represented with different
candidate characters, depending on one's personal preference or etymological
theory. In this sentence, for example, "-tàng", "chia̍h",
"mā" and "bē" are problematic using Chinese characters.
"Góa" (I/me) and "po-lê" (glass) are as written in other Sinitic
languages (e.g. Mandarin, Hakka)."
Wagner Amaral of Pinese & Amaral Associados notes that
the Brazilian Portuguese sentence for
"I can eat glass" should be identical to the Portuguese one, as the word
"machuca" means "inflict pain", or rather "injuries". The words "faz
mal" would more correctly translate as "cause harm".
Burmese: In English the first person pronoun "I" stands for both
genders, male and female. In Burmese (except in the central part of Burma)
kyundaw (က္ယ္ဝန္တော္) for male and kyanma (က္ယ္ဝန္မ) for female.
Using here a fully-compliant Unicode Burmese font -- sadly one and only Padauk
Graphite font exists -- rendering using graphite engine.
CLICK HERE to test Burmese
characters.
The "I can eat glass" sentences do not necessarily show off the orthography of
each language to best advantage. In many alphabetic written languages it is
possible to include all (or most) letters (or "special" characters) in
a single (often nonsense) pangram. These were traditionally used in
typewriter instruction; now they are useful for stress-testing computer fonts
and keyboard input methods. Here are a few examples (SEND MORE):
English: The quick brown fox jumps over the lazy dog.
Irish: "An ḃfuil do ċroí ag bualaḋ ó ḟaitíos an ġrá a ṁeall lena ṗóg éada ó
ṡlí do leasa ṫú?"
"D'ḟuascail Íosa Úrṁac na hÓiġe Beannaiṫe pór Éava agus Áḋaiṁ."
Dutch: Pa's wijze lynx bezag vroom het fikse aquaduct.
German: Falsches Üben von Xylophonmusik quält jeden
größeren Zwerg. (1)
German: Im finſteren Jagdſchloß am offenen Felsquellwaſſer patzte der affig-flatterhafte kauzig-höfliche Bäcker über ſeinem verſifften kniffligen C-Xylophon. (2)
Swedish: Flygande bäckasiner söka strax hwila på mjuka tuvor.
Icelandic: Sævör grét áðan því úlpan var ónýt.
Polish: Pchnąć w tę łódź jeża lub ośm skrzyń fig.
Czech: Příliš
žluťoučký kůň úpěl
ďábelské kódy.
Slovak: Starý kôň na hŕbe
kníh žuje tíško povädnuté
ruže, na stĺpe sa ďateľ
učí kvákať novú ódu o
živote.
Russian: В чащах
юга жил-был
цитрус? Да,
но
фальшивый
экземпляр!
ёъ.
Bulgarian: Жълтата дюля беше щастлива, че пухът, който цъфна, замръзна като гьон.
Sami (Northern): Vuol Ruoŧa geđggiid leat máŋga luosa ja čuovžža.
Hungarian: Árvíztűrő tükörfúrógép.
Spanish: El pingüino Wenceslao hizo kilómetros bajo exhaustiva lluvia y frío, añoraba a su querido cachorro.
Portuguese: O próximo vôo à noite sobre o Atlântico, põe freqüentemente o único médico. (3)
French: Les naïfs ægithales hâtifs pondant à Noël où il gèle sont sûrs d'être
déçus et de voir leurs drôles d'œufs abîmés.
Other phrases commonly used in Germany include: "Ein wackerer Bayer
vertilgt ja bequem zwo Pfund Kalbshaxe" and, more recently, "Franz jagt im
komplett verwahrlosten Taxi quer durch Bayern", but both lack umlauts and
esszet. Previously, going for the shortest sentence that has all the
umlauts and special characters, I had
"Grüße aus Bärenhöfe
(und Óechtringen)!"
Acute accents are not used in native German words, so I was surprised to
discover "Óechtringen" in the Deutsche Bundespost
Postleitzahlenbuch:
It's a small village in eastern Lower Saxony.
The "oe" in this case
turns out to be the Lower Saxon "lengthening e" (Dehnungs-e), which makes the
previous vowel long (used in a number of Lower Saxon place names such as Soest
and Itzehoe), not the "e" that indicates umlaut of the preceding vowel.
Many thanks to the Óechtringen-Namenschreibungsuntersuchungskomitee
(Alex Bochannek, Manfred Erren, Asmus Freytag, Christoph Päper, plus
Werner Lemberg who serves as
Óechtringen-Namenschreibungsuntersuchungskomiteerechtschreibungsprüfer)
for their relentless pursuit of the facts in this case. Conclusion: the
accent almost certainly does not belong on this (or any other native German)
word, but neither can it be dismissed as dirt on the page. To add to the
mystery, it has been reported that other copies of the same edition of the
PLZB do not show the accent! UPDATE (March 2006): David Krings was
intrigued enough by this report to contact the mayor of Ebstorf, of which
Oechtringen is a borough, who responded:
Sehr geehrter Mr. Krings,
wenn Oechtringen irgendwo mit einem Akzent auf dem O geschrieben wurde,
dann kann das nur ein Fehldruck sein. Die offizielle Schreibweise lautet
jedenfalls „Oechtringen“.
Mit freundlichen Grüssen
Der Samtgemeindebürgermeister
i.A. Lothar Jessel
From Karl Pentzlin (Kochel am See, Bavaria, Germany):
"This German phrase is suited for display by a Fraktur (broken letter)
font. It contains: all common three-letter ligatures: ffi ffl fft and all
two-letter ligatures required by the Duden for Fraktur typesetting: ch ck ff
fi fl ft ll ſch ſi ſſ ſt tz (all in a
manner such they are not part of a three-letter ligature), one example of f-l
where German typesetting rules prohibit ligating (marked by a ZWNJ), and all
German letters a...z, ä,ö,ü,ß, ſ [long s]
(all in a manner such that they are not part of a two-letter Fraktur
ligature)."
Otto Stolz notes that "'Schloß' is now spelled 'Schloss', in
contrast to 'größer' (example 4) which has kept its
'ß'. Fraktur has been banned from general use, in 1942, and long-s
(ſ) has ceased to be used with Antiqua (Roman) even earlier (the
latest Antiqua-ſ I have seen is from 1913, but then
I am no expert, so there may well be a later instance." Later Otto confirms
the latter theory, "Now I've run across a book “Deutsche
Rechtschreibung” (edited by Lutz Mackensen) from 1954 (my reprint
is from 1956) that has kept the Antiqua-ſ in its dictionary part (but
neither in the preface nor in the appendix)."
Diaeresis is not used in Iberian Portuguese.
From Yurio Miyazawa: "This poetry contains all the sounds in the
Japanese language and used to be the first thing for children to learn in
their Japanese class. The Hiragana version is particularly neat because it
covers every character in the phonetic Hiragana character set." Yurio also
sent the Kanji version:
色は匂へど 散りぬるを
我が世誰ぞ 常ならむ
有為の奥山 今日越えて
浅き夢見じ 酔ひもせず
Accented Cyrillic:
(This section contributed by Vladimir Marinov.)
In Bulgarian it is desirable, customary, or in some cases required to
write accents over vowels. Unfortunately, no computer character sets
contain the full repertoire of accented Cyrillic letters. With Unicode,
however, it is possible to combine any Cyrillic letter with any combining
accent. The appearance of the result depends on the font and the rendering
engine. Here are two examples.
Той видя бялата коса́ по главата и́ и ко́са на рамото и́, и ре́че да и́
рече́: "Пара́та по́ па́ри от па́рата, не ща пари́!", но си поми́сли: "Хей,
помисли́ си! А́ и́ река, а́ е скочила в тази река, която щеше да тече́,
а не те́че."
Here is the Russian alphabet (uppercase only) coded in three
different ways, which should look identical:
АБВГДЕЖЗИЙКЛМНОПРСТУФХЦЧШЩЪЫЬЭЮЯ
(Literal UTF-8)
АБВГДЕЖЗИЙКЛМНОПРСТУФХЦЧШЩЪЫЬЭЮЯ
(Decimal numeric character reference)
АБВГДЕЖЗИЙКЛМНОПРСТУФХЦЧШЩЪЫЬЭЮЯ
(Hexadecimal numeric character reference)
In another test, we use HTML language tags to distinguish Bulgarian, Russian,
and Serbian,
which have different italic forms for lowercase
б, г, д, п, and/or т:
The "I can eat glass" phrase and the initial collection of translations:
Ethan Mollick.
Transcription / conversion to UTF-8: Frank da Cruz.
Albanian: Sindi Keesan.
Afrikaans: Johan Fourie, Kevin Poalses.
Anglo Saxon: Frank da Cruz.
Arabic: Najib Tounsi.
Armenian: Vaçe Kundakçı.
Belarusian: Alexey Chernyak.
Bengali: Somnath Purkayastha, Deepayan Sarkar.
Bislama: Dan McGarry.
Braille: Frank da Cruz.
Bulgarian: Sindi Keesan, Guentcho Skordev, Vladimir Marinov.
Burmese: "cetanapa".
Cabo Verde Creole: Cláudio Alexandre Duarte.
Catalán: Jordi Bancells.
Chinese: Jack Soo, Wong Pui Lam.
Chinook Jargon: David Robertson.
Cornish: Chris Stephens.
Croatian: Marjan Baće.
Czech: Stanislav Pecha, Radovan Garabík.
Dutch: Peter Gotink. Pim Blokland, Rob Daniel, Rob de Wit.
Erzian: Jack Rueter.
Esperanto: Franko Luin, Radovan Garabík.
Estonian: Meelis Roos.
Farsi/Persian: Payam Elahi.
Finnish: Sampsa Toivanen.
French: Luc Carissimo, Anne Colin du Terrail, Sean M. Burke.
Galician: Laura Probaos.
Georgian: Giorgi Lebanidze.
German: Christoph Päper, Otto Stolz, Karl Pentzlin, David Krings,
Frank da Cruz.
Gothic: Aurélien Coudurier.
Greek: Ariel Glenn, Constantine Stathopoulos, Siva Nataraja.
Hebrew: Jonathan Rosenne, Tal Barnea.
Hausa: Malami Buba, Tom Gewecke.
Hawaiian: na Hauʻoli Motta, Anela de Rego, Kaliko Trapp.
Hindi: Shirish Kalele.
Hungarian: András Rácz, Mark Holczhammer.
Icelandic: Andrés Magnússon, Sveinn Baldursson.
International Phonetic Alphabet (IPA): Siva Nataraja / Vincent Ramos.
Irish: Michael Everson, Marion Gunn, James Kass, Curtis Clark.
Italian: Thomas De Bellis.
Japanese: Makoto Takahashi, Yurio Miyazawa.
Kirchröadsj: Roger Stoffers.
Kreyòl: Sean M. Burke.
Korean: Jungshik Shin.
Langenfelder Platt: David Krings.
Lëtzebuergescht: Stefaan Eeckels.
Lithuanian: Gediminas Grigas.
Lojban: Edward Cherlin.
Lusatian: Ronald Schaffhirt.
Macedonian: Sindi Keesan.
Malay: Zarina Mustapha.
Manx: Éanna Ó Brádaigh.
Marathi: Shirish Kalele.
Marquesan: Kaliko Trapp.
Middle English: Frank da Cruz.
Milanese: Marco Cimarosti.
Mongolian: Tom Gewecke.
Napoletano: Diego Quintano.
Navajo: Tom Gewecke.
Nórdicg:
Yẃlyan Rott.
Norwegian: Herman Ranes.
Odenwälderisch: Alexander Heß.
Old Irish: Michael Everson.
Old Norse: Andrés Magnússon.
Papiamentu: Bianca and Denise Zanardi.
Pashto: N.R. Liwal.
Pfälzisch: Dr. Johannes Sander.
Picard: Philippe Mennecier.
Polish: Juliusz Chroboczek, Paweł Przeradowski.
Portuguese: "Cláudio" Alexandre Duarte, Bianca and Denise
Zanardi, Pedro Palhoto Matos, Wagner Amaral.
Québécois: Laurent Detillieux.
Roman: Pierpaolo Bernardi.
Romanian: Juliusz Chroboczek, Ionel Mugurel.
Ruhrdeutsch: "Timwi".
Russian: Alexey Chernyak, Serge Nesterovitch.
Sami: Anne Colin du Terrail, Luc Carissimo.
Sanskrit: Siva Nataraja / Vincent Ramos.
Sächsisch: André Müller.
Schwäbisch: Otto Stolz.
Scots: Jonathan Riddell.
Serbian: Sindi Keesan, Ranko Narancic, Boris Daljevic, Szilvia Csorba.
Slovak: G. Adam Stanislav, Radovan Garabík.
Slovenian: Albert Kolar.
Spanish:Aleida
Muñoz, Laura Probaos.
Swahili: Ronald Schaffhirt.
Swedish: Christian Rose, Bengt Larsson.
Taiwanese: Henry H. Tan-Tenn.
Tagalog: Jim Soliven.
Tamil: Vasee Vaseeharan.
Tibetan: D. Germano, Tom Gewecke.
Thai: Alan Wood's wife.
Turkish: Vaçe Kundakçı, Tom Gewecke, Merlign Olnon.
Ukrainian: Michael Zajac.
Urdu: Mustafa Ali.
Vietnamese: Dixon Au,
[James] Đỗ Bá Phước
杜 伯 福.
Walloon: Pablo Saratxaga.
Welsh: Geiriadur Prifysgol Cymru (Andrew).
Yiddish: Mark David,
Zeneise: Angelo Pavese.
Tools Used to Create This Web Page:
The UTF8-aware Kermit 95 terminal emulator on
Windows, to a Unix host with the EMACS text editor. Kermit
95 displays UTF-8 and also allows keyboard entry of arbitrary Unicode BMP
characters as 4 hex digits, as shown HERE. Hex codes
for Unicode values can be found in The Unicode
Standard (recommended) and the online code charts. When
submissions arrive by email encoded in some other character set (Latin-1,
Latin-2, KOI, various PC code pages, JEUC, etc), I use the TRANSLATE command
of C-Kermit on the Unix host (where I read my mail) to convert the character set to
UTF-8 (I could also use Kermit 95 for this; it has the same TRANSLATE
command). That's it -- no "Web authoring" tools, no locales, no "smart"
anything. It's just plain text, nothing more. By the way, there's nothing
special about EMACS -- any text editor will do, providing it allows entry of
arbitrary 8-bit bytes as text, including the 0x80-0x9F "C1" range. EMACS 21.1
actually supports UTF-8; earlier versions don't know about it and display the
octal codes; either way is OK for this purpose.
Commentary:
Date: Wed, 27 Feb 2002 13:21:59 +0100
From: "Bruno DEDOMINICIS" <b.dedominicis@cite-sciences.fr>
Subject: Je peux manger du verre, cela ne me fait pas mal.
I just found out your website and it makes me feel like proposing an
interpretation of the choice of this peculiar phrase.
Glass is transparent and can hurt as everyone knows. The relation between
people and civilisations is sometimes effusional and more often rude. The
concept of breaking frontiers through globalization, in a way, is also an
attempt to deny any difference. Isn't "transparency" the flag of modernity?
Nothing should be hidden any more, authority is obsolete, and the new powers
are supposed to reign through loving and smiling and no more through
coercion...
Eating glass without pain sounds like a very nice metaphor of this attempt.
That is, frontiers should become glass transparent first, and be denied by
incorporating them. On the reverse, it shows that through globalization,
frontiers undergo a process of displacement, that is, when they are not any
more speakable, they become repressed from the speech and are therefore
incorporated and might become painful symptoms, as for example what happens
when one tries to eat glass.
The frontiers that used to separate bodies one from another tend to divide
bodies from within and make them suffer.... The chosen phrase then appears
as a denial of the symptom that might result from the destitution of
traditional frontiers.