ISO 639

Last updated

ISO 639 is a standard by the International Organization for Standardization (ISO) concerned with representation of languages and language groups. It currently consists of four sets (1-3, 5) of code, named after each part which formerly described respective set (part 4 was guidelines without its own coding system); a part 6 was published but withdrawn. It was first approved in 1967 as a single-part ISO Recommendation, ISO/R 639, [1] superseded in 2002 by part 1 of the new series, ISO 639-1, [2] followed by additional parts. All existing parts of the series were consolidated into a single standard in 2023, [3] largely based on the text of ISO 639-4.

Contents

Use of ISO 639 codes

The language codes defined in the several sections of ISO 639 are used for bibliographic purposes and, in computing and internet environments, as a key element of locale data. The codes also find use in various applications, such as Wikipedia URLs for its different language editions.

History

The early form of ISO's language coding system was manifested by ISO/R 639:1967 titled Symbols for Languages, Countries and Authorities, which aimed chiefly to regulate vocabularies signifying languages, countries, and standardization agencies of ISO member bodies. Its "language symbols" consisted of one- or two-letter variable-length identifiers in capitalized Latin alphabets, e.g. E or En for English; S, Sp, or Es for Spanish; and In for Indonesian. It was also allowed to use (the pre-1993 version of) UDC numeral auxiliaries to indicate languages.

List of language symbols in ISO/R 639:1967
Name (English)1-letter2-letterUDC(1988)(Current Set 1)
AfrikaansAf=393.6afaf
ArabicAr=927arar
BulgarianBg=867bgbg
ChineseCCh=951zhzh
CzechCs=850cscs
GermanDDe=30dede
DanishDa=398dada
EnglishEEn=20enen
EsperantoEo=089.2eoeo
SpanishSEsSp=60eses
FrenchFFr=40frfr
FinnishFi=945.41fifi
GreekGGr=75elel
HebrewHe=924iwhe
HindiHi=914.3hihi
HungarianHu=945.11huhu
ItalianIIt=50itit
InterlinguaIa=089.7iaia
InterlingueIe=089.6ieie
IndonesianIn=992.21inid
JapaneseJJa=956jaja
KoreanKo=957koko
LatinLLa=71lala
DutchNl=393.1nlnl
NorwegianNo=396nono
PolishPl=84plpl
PortuguesePt=690ptpt
RussianRRu=82ruru
RomanianRo=590roro
SanskritSa=912.3sasa
Serbo-CroatSh=861/862sh
SlovakSk=854sksk
SlovenianSn=863slsl
SwedishSv=397svsv
TurkishTr=943.5trtr
UkrainianUk=83ukuk
UrduUr=914.31urur

After decoupling the country code into ISO 3166 in 1974, the first edition of the standard ISO 639:1988 Code for the representation of names of languages was published with a framework of uniformly two-letter identifiers in lowercase Latin alphabets, mostly identical in format and vocabulary to that of the current ISO 639 Set 1.

Since then, the standard has been adopted as a fundamental technology of the rapidly expanding computer industry (RFC 1766), leading to development of more expressive three-letter framework, published as ISO 639-2:1998, largely based on MARC codes for languages. The original two-letter system was redefined as ISO 639-1 in 2001.

Seeking for more extensive support of languages for widening applications, separate supersets of the ISO 639-2 namespace that cover individual languages and groups were established as ISO 639-3 and ISO 639-5, respectively. There was also an attempt to code more precise language variants using four-letter identifiers as ISO 639-6, which was later withdrawn and to be reorganized under another framework, ISO 21636.

Relatively constant updates in parts of ISO 639 had been handled by each own authority in charge until the publication of ISO 639:2023, which harmonized and reunified the body text of former standards and brought about organizational change with a joint maintenance agency supervising all sets and issuing newsletters.

Current sets and historical parts of the standard

Set (past Part)Former name (Codes for the representation of names of languages – ...)Registration AuthorityFirst editionCurrentNo. in list (as of 12 July 2023)
Set 1 Part 1: Alpha-2 code Infoterm 1967 (original ISO/R 639)2023 183
Set 2 Part 2: Alpha-3 code Library of Congress 19982023 482 + 20 B-only + 4 special + 520 for local use [4] [5]
Set 3 Part 3: Alpha-3 code for comprehensive coverage of languages SIL International 20072023 7,916 + 4 special + 520 for local use [6]
(ISO 639-4)Part 4: Implementation guidelines and general principles for language coding ISO/TC 37/SC 2 2010-07-162023(not a list)
Set 5 Part 5: Alpha-3 code for language families and groupsLibrary of Congress2008-05-152023 115 (including 36 remainder + 29 regular groups from ISO 639-2) [7]
(ISO 639-6)Part 6: Alpha-4 representation for comprehensive coverage of language variants (withdrawn)Geolang2009-11-17withdrawn21,000+

Each set of the standard is maintained by a maintenance agency, which adds codes and changes the status of codes when needed. ISO 639-6 was withdrawn in 2014, [8] and not included in ISO 639:2023.

Characteristics of individual codes

Scopes:

Types (for individual languages):[ needs update ]

Individual languages and macrolanguages with two distinct three-letter codes in Set 2:

Relations between the sets

The different sets of ISO 639 are designed to work together, in such a way that no code means one thing in one set and something else in another. However, not all languages are in all sets, and there is a variety of different ways that specific languages and other elements are treated in the different sets. This depends, for example, whether a language is listed in Sets 1 or 2, whether it has separate B/T codes in Set 2, or is classified as a macrolanguage in Set 3, and so forth.

These various treatments are detailed in the following chart. In each group of rows (one for each scope of Set 3), the last four columns contain codes for a representative language that exemplifies a specific type of relation between the sets of ISO 639, the second column provides an explanation of the relationship, and the first column indicates the number of elements that have that type of relationship. For example, there are four elements that have a code in Set 1, have a B/T code, and are classified as macrolanguages in Set 3. One representative of these four elements is "Persian" fa/per/fas.

ScopeNumber of casesDescriptionExample of matching codes
ISO 639 Set 1ISO 639 Set 2ISO 639 Set 3ISO 639 Set 5
Individual languages
("I")
128Individual languages not part of a macrolanguage, with code in each Set 1, 2 and 3 (only one code in Set 2).
There are 184 assigned codes in Set 1 for individual languages, macrolanguages or groups; subtract those counted in rows below, this leaves: 184 - (2 "I (former B/T)") ‒ (3+11 "I") ‒ (3+2 "I (B/T)") ‒ (28+4+1+1 "M") ‒ (1 "C") = 128 codes.
eneng
2Individual languages, with code in each Set 1, 2 and 3, that had separate B/T codes in Set 2, but whose B codes were withdrawn (since 2008-06-28) keeping their T codes for all uses. These are: hr/(scr)/hrv, and sr/(scc)/srp.
Both are part of the same macrolanguage hbs added in Set 3 to include also other newly encoded individual languages, but its code sh in Set 1 was also withdrawn and it had no code defined in Set 2.
hr(scr)/hrv (B/T)hrv
3Individual languages belonging to a macrolanguage in Set 3, with a single code in Set 2 and also having a code in Set 1. These are: bs/bos (part of macrolanguage hbs), nb/nob and nn/nno (both part of macrolanguage no/nor).nbnob
11Individual languages with separate B/T codes in Set 2, but not in any of the special cases in succeeding lines.
There are 20 pairs of separate B/T codes assigned in Set 2 to individual languages or macrolanguages; subtract the special cases below, this leaves: 20 ‒ (3+2 "M") ‒ (4 "C") = 11 pairs of codes.
deger/deu (B/T)deu
3Individual languages with separate B/T codes in Set 2 but the letters from the Set 1 code are not the first two letters of the Set 2T code. These are: cs/cze/ces, mi/mao/mri, and sk/slo/slk.cscze/ces (B/T)ces
3Individual languages in Sets 2 and 3 (do not belong to a macrolanguage), but that were covered in Set 1 by a code whose equivalent in Set 2 is a collective. These are: bho, mai, and mag.(bh)bho
fewAny other individual language in Sets 2 and 3, without code in Set 1.ast
1Individual languages added in Set 3 without codes in Sets 1 and 2, but that were covered by a macrolanguage in Sets 2 and 3 also encoded in Set 1.(ar)(ara)arb
1An individual language in Set 3, without code in Set 2, but was covered in Set 1 by a code whose equivalent in Set 2 is a collective group (see the entry below for this group).(bh)(bih)sck
> 7,000Any other individual language in Set 3 without any code in Sets 1 and 2 (possibly covered in Set 2 by a collective code, like nic "Niger-Kodofanian (Other)" which is a remainder group).(nic)aaa
Macrolanguages
("M")
28Macrolanguages in Set 3 that also have codes in Set 1 and 2.
There are 62 codes assigned in Set 3 for macrolanguages; subtract those with special cases below, this leaves: 62 ‒ (4 "B/T") ‒ 1 ‒ (25+1+3 "not in Set 1") = 28 codes.
arara
4Macrolanguages in Set 3 with separate B/T codes in Set 2. These are: fa/per/fas, ms/may/msa, sq/alb/sqi, and zh/chi/zho.faper/fas (B/T)fas
1Macrolanguage in Set 3 which contain languages that have codes in Set 1. Only: no/nor (containing: nb/nob, and nn/nno).nonor
25Macrolanguages in Sets 2 and 3, but without code in Set 1.bal
1Macrolanguage in Set 3, without code in Set 2, and whose code in Set 1 is deprecated.(sh)hbs
3Macrolanguages in Set 3, without codes in Set 1 or 2. These are: bnc, kln, and luy.bnc
Families and groups (collective)
("C")
1 Bihari is marked as collective and has a Set 2 code. It was having a Set 1 code but deprecated in 2021. [9] The reason was that three individual Bihari languages (which are different enough that they can not form the same macrolanguage for Set 3) received distinctive Set 2 codes (bho, mai, mag), which made Bihari a remainder group for the purposes of Set 2 (containing languages of the group except these three).(bh)bihbih
35Remainder groups in Set 2, i.e. same code but different languages included. In Set 2, afa refers to an Afro-Asiatic language that does not have an individual-language identifier in Set 2, and that does not fall into the three remainder groups: ber "Berber (Other)", cus "Cushitic (Other)", or sem "Semitic (Other)", all of which are Afro-Asiatic language groups.afaafa
29Regular group in Set 2, same as the language family in Set 5, no code in Set 1. Among them, the regular group ypk in Set 2 was the only one to have been encoded in Set 5 as part of another new regular group in Set 5 that was not coded in Set 2 (see below).ausaus
50Regular groups added only in Set 5, not previously coded in Sets 1, 2 and 3. Most of these new regular groups may have been previously represented by another collective code in Set 2 as part of a remainder group (for example the remainder group ine for the new regular group sqj), except 7 of them: aav, esx, euq, hmx, jpx, urj, as well as syd (part of the new regular group urj). The regular group ypk (part of the new regular group esx) however was already coded in Set 2. See the hierarchy of language groups in List of ISO 639 Set 5 codes.sqj
Special codes
("S")
1Available to be used in a monolingual context where an individual language code is required, but the language itself has no standard code. A more precise alternative could be using a remainder group from Set 2 or a language family code from Set 5, unless other languages in such group must be excluded (as they are separated with their own code) or no standard collective code is suitable. Some applications may prefer using a more specific code within those reserved for local use.mis
1Multilingual content (includes at least two languages in separatable sets). To be used when a single language code is expected for the whole content. The individual languages or macrolanguages for each part of the content may be possibly still unencoded (and representable as mis or more precisely with a collective code).mul
1Undetermined (content includes zero, one or many languages, in arbitrary combination).und
1No linguistic information at all (added 2006-01-11). The content (e.g. graphics, photos or audio/video records not including text in a human language, or technical metadata and most programming source code) is usable as is with any language and should not be translated (except for its description possibly associated in separate contents, or for non-essential fragments of the content).zxx
Reserved for local use
("R")
20Two-letter codes in Set 1, in range qa .. qt. These codes are not recommended, but left unassigned in Set 1.qa
520Three-letter codes in Sets 2 and 3, in range qaa ... qtz. These codes may also be used for collective languages (or other special cases), but no standard language families and groups will be assigned with them in Set 5.qaa

These differences are due to the following factors.

In ISO 639 Set 2, two distinct codes were assigned to 22 individual languages, namely a bibliographic and a terminology code (B/T codes). [15] B codes were included for historical reasons because previous widely used bibliographic systems used language codes based on the English name for the language. In contrast, the Set 1 codes were based on the native name for the language, and there was also a strong desire to have Set 2 codes (T codes) for these languages which were similar to the corresponding 2-character code in Set 1.

Individual languages in Set 2 always have a code in Set 3 (only the Set 2 terminology code is reused there) but may or may not have a code in Set 1, as illustrated by the following examples:

Some codes (62) in Set 3 are macrolanguages. These are groups containing multiple individual languages that have a good mutual understanding and are commonly mixed or confused. Some macrolanguages developed a default standard form on one of their individual languages (e.g. Mandarin is implied by default for the Chinese macrolanguage, other individual languages may be still distinguished if needed but the specific code cmn for Mandarin is rarely used).

Collective codes in Set 2 have a code in Set 5: e.g. aus in Sets 2 and 5, which stands for Australian languages.

Sets 2 and 3 also have a reserved range and four special codes:

Code space

Two-letter code space

Two-letter (formerly "Alpha-2") identifiers (for codes composed of 2 letters of the ISO basic Latin alphabet) are used in Set 1. When codes for a wider range of languages were desired, more than 2 letter combinations could cover (a maximum of 262 = 676), Set 2 was developed using three-letter codes. (However, the latter was formally published first. [16] [17] )

Three-letter code space

Three-letter (formerly "Alpha-3") identifiers (for codes composed of 3 letters of the ISO basic Latin alphabet) are used in Set 2, Set 3, and Set 5. The number of languages and language groups that can be so represented is 263 = 17,576.

The common use of three-letter codes by three sets of ISO 639 requires some coordination within a larger system.

Set 2 defines four special codes mis, mul, und, zxx, a reserved range qaa-qtz (20 × 26 = 520 codes) and has 20 double entries (the B/T codes), plus 2 entries with deprecated B-codes. This sums up to 520 + 22 + 4 = 546 codes that cannot be used in Set 3 to represent languages or in Set 5 to represent language families or groups. The remainder is 17,576 – 546 = 17,030.

There are somewhere around six to seven thousand languages on Earth today. [18] So those 17,030 codes are adequate to assign a unique code to each language, although some languages may end up with arbitrary codes that sound nothing like the traditional name(s) of that language.

Alpha-4 code space (withdrawn)

"Alpha-4" codes (for codes composed of 4 letters of the ISO basic Latin alphabet) were proposed to be used in ISO 639-6, which has been withdrawn. The upper limit for the number of languages and dialects that can be represented is 264 = 456,976.

See also

Notes and references

  1. "ISO/R 639:1967". International Organization for Standardization. 1988-03-01. Retrieved 2012-08-05.
  2. "ISO 639:1988". International Organization for Standardization. Retrieved 2012-08-05.
  3. "ISO 639:2023". International Organization for Standardization. Retrieved 2023-11-15.
  4. "Codes arranged alphabetically by alpha-3/ISO 639-2 Code". Library of Congress. 2013-07-25. Retrieved 2019-01-10.
  5. "ISO-639-2 Codes". Library of Congress. Retrieved 2019-01-10.
  6. "ISO 639-3 Code Set (UTF-8)". SIL International. Retrieved 2023-07-12.
  7. "ISO 639-5 codes ordered by Identifier". Network Development & MARC Standards Office. Library of Congress. Retrieved December 12, 2018.
  8. ISO 639-6:2009, ISO.
  9. 1 2 SIL International (2021-06-14). "Change to Part 1 Language Code". ISO 639-3.
  10. "ISO 639 code tables: macrolanguages". Sil.org. Retrieved 2012-08-05.
  11. "ISO 639 code tables: extinct". Sil.org. Retrieved 2012-08-05.
  12. "ISO 639 code tables: ancient". Sil.org. Retrieved 2019-01-10.
  13. "ISO 639 code tables: historical". Sil.org. Retrieved 2012-08-05.
  14. "ISO 639 code tables: constructed". Sil.org. Retrieved 2022-02-07.
  15. "ISO 639-2 Frequently Asked Questions". Library of Congress. 2014-05-05. Retrieved 2014-12-12.
  16. "Codes for the representation of names of languages -- Part 2: Alpha-3 code". International Organization for Standards. ISO. Retrieved 10 January 2019. Publication date : 1998-10
  17. "Codes for the representation of names of languages -- Part 1: Alpha-2 code". International Organization for Standards. ISO. Retrieved 15 February 2018. Publication date : 2002-07
  18. "Statistical Summaries". Ethnologue. Retrieved 2012-08-05.

Related Research Articles

ISO 639-1:2002, Codes for the representation of names of languages—Part 1: Alpha-2 code, is the first part of the ISO 639 series of international standards for language codes. Part 1 covers the registration of "set 1" two-letter codes. There are 183 two-letter codes registered as of June 2021. The registered codes cover the world's major languages.

ISO 639-2:1998, Codes for the representation of names of languages — Part 2: Alpha-3 code, is the second part of the ISO 639 standard, which lists codes for the representation of the names of languages. The three-letter codes given for each language in this part of the standard are referred to as "Alpha-3" codes. There are 487 entries in the list of ISO 639-2 codes.

ISO 639-3:2007, Codes for the representation of names of languages – Part 3: Alpha-3 code for comprehensive coverage of languages, is an international standard for language codes in the ISO 639 series. It defines three-letter codes for identifying languages. The standard was published by International Organization for Standardization (ISO) on 1 February 2007.

ISO 639-5:2008 "Codes for the representation of names of languages—Part 5: Alpha-3 code for language families and groups" is an international standard published by the International Organization for Standardization (ISO). It was developed by ISO Technical Committee 37, Subcommittee 2, and first published on May 15, 2008. It is part of the ISO 639 series of standards.

ISO 639-6, Codes for the representation of names of languages — Part 6: Alpha-4 code for comprehensive coverage of language variants, was a proposed international standard in the ISO 639 series, developed by ISO/TC 37/SC 2. It contained four-letter codes that denote variants of languages and language families. This allowed one to differentiate between, for example, historical (glvx) versus revived (rvmx) Manx, while ISO 639-3 only includes glv for Manx.

This is a list of ISO 639-3 language codes starting with A.


This is a list of ISO 639-3 language codes starting with B.


This is a list of ISO 639-3 language codes starting with E.


This is a list of ISO 639-3 language codes starting with I.


This is a list of ISO 639-3 language codes starting with M.


This is a list of ISO 639-3 language codes starting with O.


This is a list of ISO 639-3 language codes starting with S.


This is a list of ISO 639-3 language codes starting with U.


This is a list of ISO 639-3 language codes starting with X.


A macrolanguage is a group of mutually intelligible speech varieties, or dialect continuum, that have no traditional name in common, and which may be considered distinct languages by their speakers. Macrolanguages are used as a book-keeping mechanism for the ISO 639 international standard of language codes. Macrolanguages are established to assist mapping between different sets of ISO language codes. Specifically, there may be a many-to-one correspondence between ISO 639-3, intended to identify all the thousands of languages of the world, and either of two other sets, ISO 639-1, established to identify languages in computer systems, and ISO 639-2, which encodes a few hundred languages for library cataloguing and bibliographic purposes. When such many-to-one ISO 639-2 codes are included in an ISO 639-3 context, they are called "macrolanguages" to distinguish them from the corresponding individual languages of ISO 639-3. According to the ISO,

Some existing code elements in ISO 639-2, and the corresponding code elements in ISO 639-1, are designated in those parts of ISO 639 as individual language code elements, yet are in a one-to-many relationship with individual language code elements in [ISO 639-3]. For purposes of [ISO 639-3], they are considered to be macrolanguage code elements.

ISO 639 is a set of standards by the International Organization for Standardization that is concerned with representation of names for languages and language groups. Lists of ISO 639 codes are:

An IETF BCP 47 language tag is a standardized code that is used to identify human languages on the Internet. The tag structure has been standardized by the Internet Engineering Task Force (IETF) in Best Current Practice (BCP) 47; the subtags are maintained by the IANA Language Subtag Registry.

This page is a list of lists of languages.