Wiktionary

Last updated

Wiktionary
WiktionaryEn - DP Derivative.svg
Logo of English Wiktionary
Screenshot
English Wiktionary Main Page.png
Main Page of the English Wiktionary on April 2, 2019.
Type of site
Online dictionary
Available in Multilingual (168 active) [1]
Owner Wikimedia Foundation
Created by
URL wiktionary.org
CommercialNo
RegistrationOptional
LaunchedDecember 12, 2002;21 years ago (2002-12-12)
Current statusActive

Wiktionary ( UK: /ˈwɪkʃənəri/ , WIK-shə-nər-ee; US: /ˈwɪkʃənɛri/ , WIK-shə-nerr-ee; rhyming with "dictionary") is a multilingual, web-based project to create a free content dictionary of terms (including words, phrases, proverbs, linguistic reconstructions, etc.) in all natural languages and in a number of artificial languages. These entries may contain definitions, images for illustration, pronunciations, etymologies, inflections, usage examples, quotations, related terms, and translations of terms into other languages, among other features. It is collaboratively edited via a wiki. Its name is a portmanteau of the words wiki and dictionary . It is available in 192 languages and in Simple English. Like its sister project Wikipedia, Wiktionary is run by the Wikimedia Foundation, and is written collaboratively by volunteers, dubbed "Wiktionarians". Its wiki software, MediaWiki, allows almost anyone with access to the website to create and edit entries.

Contents

Because Wiktionary is not limited by print space considerations, most of Wiktionary's language editions provide definitions and translations of terms from many languages, and some editions offer additional information typically found in thesauri.

Wiktionary's data is frequently used in various natural language processing tasks.

History and development

Wiktionary was brought online on December 12, 2002, [2] following a proposal by Daniel Alston and an idea by Larry Sanger, co-founder of Wikipedia. [3] On March 28, 2004, the first non-English Wiktionaries were initiated in French and Polish. Wiktionaries in numerous other languages have since been started. Wiktionary was hosted on a temporary domain name (wiktionary.wikipedia.org) until May 1, 2004, when it switched to the current domain name. [lower-alpha 1] As of July 2021, Wiktionary features over 30 million articles (and even more entries) across its editions. [4] The largest of the language editions is the English Wiktionary, with over 7.5 million entries, followed by the French Wiktionary with over 4.7 million and the Malagasy Wiktionary with over 3.5 million entries. Forty-three Wiktionary language editions contain over 100,000 entries each. [lower-alpha 2]

The use of bots to generate large numbers of articles is visible as "growth spurts" in this graph of article counts at the largest eight Wiktionary editions. (Data as of December 2009
) Wiktionary growth.png
The use of bots to generate large numbers of articles is visible as "growth spurts" in this graph of article counts at the largest eight Wiktionary editions. (Data as of December 2009)

Many of the definitions at the project's largest language editions were created by bots that found creative ways to generate entries or (rarely) automatically imported thousands of entries from previously published dictionaries. Seven of the 18 bots registered at the English Wiktionary in 2007 [lower-alpha 3] created 163,000 of the entries there. [5]

Another of these bots, "ThirdPersBot", was responsible for the addition of a number of third-person conjugations that would not have received their own entries in standard dictionaries; for instance, it defined "smoulders" as the "third-person singular simple present form of smoulder." Of the 1,269,938 definitions the English Wiktionary provides for 996,450 English words, 478,068 are "form of" definitions of this kind. [6] This means that even without such entries, its coverage of English is significantly larger than that of major monolingual print dictionaries. Merriam-Webster's Third New International Dictionary of the English Language, Unabridged, for instance, has 475,000 entries (with many additional embedded headwords); the Oxford English Dictionary has 615,000 headwords, but includes Middle English as well, for which the English Wiktionary has an additional 34,234 gloss definitions. Detailed statistics exist to show how many entries of various kinds exist.

The English Wiktionary does not rely on bots to the extent that some other editions do. The French and Vietnamese Wiktionaries, for example, imported large sections of the Free Vietnamese Dictionary Project (FVDP), which provides free content bilingual dictionaries to and from Vietnamese. [lower-alpha 4] These imported entries make up virtually all of the Vietnamese edition's contents. Like the English edition, the French Wiktionary has imported approximately 20,000 entries from the Unihan database of Chinese, Japanese, Korean and Indian characters. The French Wiktionary grew rapidly in 2006 thanks in a large part to bots copying many entries from old, freely licensed dictionaries, such as the eighth edition of the Dictionnaire de l'Académie française (1935, around 35,000 words), and using bots to add words from other Wiktionary editions with French translations. The Russian edition grew by nearly 80,000 entries as "LXbot" added boilerplate entries (with headings, but without definitions) for words in English and German. [7]

As of July 2021, the English Wiktionary has over 791,870 gloss definitions and over 1,269,938 total definitions (including different forms) for English entries alone, with a total of over 9,928,056 definitions across all languages. [8]

Logos

Wiktionary has historically lacked a uniform logo across its numerous language editions. Some editions use logos that depict a dictionary entry about the term "Wiktionary", based on the previous English Wiktionary logo, which was designed by Brooke Vibber, a MediaWiki developer. [9] Because a purely textual logo must vary considerably from language to language, a four-phase contest to adopt a uniform logo was held at the Wikimedia Meta-Wiki from September to October 2006. [lower-alpha 5] Some communities adopted the winning entry by "Smurrayinchester", a 3×3 grid of wooden tiles, each bearing a character from a different writing system. However, the poll did not see as much participation from the Wiktionary community as some community members had hoped, and a number of the larger wikis ultimately kept their textual logos. [lower-alpha 5]

In April 2009, the issue was resurrected with a new contest. This time, a depiction by "AAEngelman" of an open hardbound dictionary won a head-to-head vote against the 2006 logo, but the process to refine and adopt the new logo then stalled. [10] In the following years, some wikis replaced their textual logos with one of the two newer logos. In 2012, 55 wikis that had been using the English Wiktionary logo received localized versions of the 2006 design by "Smurrayinchester". [lower-alpha 6] In July 2016, the English Wiktionary adopted a variant of this logo. [11] As of 4 July 2016, 135 wikis, representing 61% of Wiktionary's entries, use a logo based on the 2006 design by "Smurrayinchester", 33 wikis (36%) use a textual logo, and three wikis (3%) use the 2009 design by "AAEngelman". [12]

Multi-lingual

As of February2024, there are Wiktionary sites for 192 languages of which 168 are active and 24 are closed. [1] The active sites have 38,344,050 articles, and the closed sites have 339 articles. [13] There are 7,202,179 registered users of which 6,058 are recently active. [13]

The top ten Wiktionary language projects by mainspace article count: [13]

LanguageWikiGoodTotalEditsAdminsUsersActive usersFiles
1English en 7,945,8319,348,96178,174,073824,158,4382,35021
2French fr 5,033,3425,635,23033,584,10135366,4875206
3Malagasy mg 4,126,8864,189,83732,639,072211,724313
4Chinese zh 1,530,9252,136,3068,066,17910118,574681
5Greek el 1,488,7461,544,6946,624,6111159,7638423
6Russian ru 1,342,9842,844,08313,325,40715311,134266188
7German de 1,113,7601,293,2839,963,85814235,595204104
8Kurdish ku 1,000,0461,095,8525,994,252712,0254715
9Spanish es 924,660982,6955,297,4909164,64913114
10Swedish sv 920,519958,7354,002,9231356,415551

For a complete list with totals see Wikimedia Statistics: [14]

Critical reception

Critical reception of Wiktionary has been mixed. In 2006, Jill Lepore wrote in the article "Noah's Ark" for The New Yorker, [lower-alpha 7]

There's no show of hands at Wiktionary. There's not even an editorial staff. "Be your own lexicographer!", might be Wiktionary's motto. Who needs experts? Why pay good money for a dictionary written by lexicographers when we could cobble one together ourselves?

Wiktionary isn't so much republican or democratic as Maoist. And it's only as good as the copyright-expired books from which it pilfers.

Keir Graff's review for Booklist was less critical:

Is there a place for Wiktionary? Undoubtedly. The industry and enthusiasm of its many creators are proof that there's a market. And it's wonderful to have another strong source to use when searching the odd terms that pop up in today's fast-changing world and the online environment. But as with so many Web sources (including this column), it's best used by sophisticated users in conjunction with more reputable sources.[ citation needed ]

References in other publications are fleeting and part of larger discussions of Wikipedia, not progressing beyond a definition, although David Brooks in The Nashua Telegraph described it as "wild and woolly". [16] One of the impediments to independent coverage of Wiktionary is the continuing confusion that it is merely an extension of Wikipedia. [lower-alpha 8]

The measure of correctness of the inflections for a subset of the Polish words in the English Wiktionary showed that this grammatical data is very stable (a study showed that only 131 out of 4,748 Polish words have had their inflection data corrected). [17]

As of 2016, Wiktionary has seen growing use in academia. [18]

Wiktionary data in natural language processing

Wiktionary has semi-structured data. [19] Wiktionary lexicographic data can be converted to machine-readable format in order to be used in natural language processing tasks. [20] [21] [22]

Wiktionary's data mining is a complex task. There are the following difficulties: [23]

There are several parsers for different Wiktionary language editions: [24]

Examples of natural language processing tasks which have been solved with the help of Wiktionary data include:

"Wikidata:Lexicographical data" was started in 2018 to provide structured data support to Wiktionaries. It stores word data of all languages in a machine readable data model, under a dedicated "Lexeme" namespace in Wikidata. As of October 2021, the project has amassed over 600,000 lexeme entries of various languages. [47]

See also

Notes

  1. Wiktionary's current URL is www.wiktionary.org
  2. Wiktionary total article counts are here. Detailed statistics by word type are available here .
  3. The user list at the English Wiktionary identifies accounts that have been given "bot status".
  4. Hồ Ngọc Đức, Free Vietnamese Dictionary Project. Details at the Vietnamese Wiktionary.
  5. 1 2 "Wiktionary/logo", Meta-Wiki, Wikimedia Foundation.
  6. [Translators-l] 56 Wiktionaries got a localised logo
  7. The full article is not available on-line. [15]
  8. In this citation, the author refers to Wiktionary as part of the Wikipedia site: Adapted from an article by Naomi DeTullio (2006). "Wikis for Librarians" (PDF). NETLS News #142. Northeast Texas Library System. p. 15. Archived from the original (PDF newsletter) on June 5, 2007. Retrieved April 21, 2007.
  9. E.g. compare the entry structure and formatting rules in English Wiktionary and Russian Wiktionary.
  10. Quotations are extracted only from Russian Wiktionary. [33]
  11. If there are several IPA notations on a Wiktionary page – either for different languages or for pronunciation variants, then the first pronunciation was extracted. [39]
  12. The source code and the results of POS-tagging are available at https://code.google.com/p/wikily-supervised-pos-tagger

Related Research Articles

<span class="mw-page-title-main">Encyclopedia</span> Type of reference work

An encyclopedia or encyclopaedia is a reference work or compendium providing summaries of knowledge, either general or special, to a particular field or discipline. Encyclopedias are divided into articles or entries that are arranged alphabetically by article name or by thematic categories, or else are hyperlinked and searchable. Encyclopedia entries are longer and more detailed than those in most dictionaries. Generally speaking, encyclopedia articles focus on factual information concerning the subject named in the article's title; this is unlike dictionary entries, which focus on linguistic information about words, such as their etymology, meaning, pronunciation, use, and grammatical forms.

<span class="mw-page-title-main">History of Wikipedia</span>

Wikipedia, a free-content online encyclopedia written and maintained by a community of volunteers known as Wikipedians, began with its first edit on 15 January 2001, two days after the domain was registered. It grew out of Nupedia, a more structured free encyclopedia, as a way to allow easier and faster drafting of articles and translations.

Rebol is a cross-platform data exchange language and a multi-paradigm dynamic programming language designed by Carl Sassenrath for network communications and distributed computing. It introduces the concept of dialecting: small, optimized, domain-specific languages for code and data, which is also the most notable property of the language according to its designer Carl Sassenrath:

Although it can be used for programming, writing functions, and performing processes, its greatest strength is the ability to easily create domain-specific languages or dialects

Word-sense disambiguation (WSD) is the process of identifying which sense of a word is meant in a sentence or other segment of context. In human language processing and cognition, it is usually subconscious/automatic but can often come to conscious attention when ambiguity impairs clarity of communication, given the pervasive polysemy in natural language. In computational linguistics, it is an open problem that affects other computer-related writing, such as discourse, improving relevance of search engines, anaphora resolution, coherence, and inference.

<span class="mw-page-title-main">MediaWiki</span> Free and open-source wiki software

MediaWiki is free and open-source wiki software originally developed by Magnus Manske for use on Wikipedia on January 25, 2002, and further improved by Lee Daniel Crocker, after which it has been coordinated by the Wikimedia Foundation. It powers several wiki hosting websites across the Internet, as well as most websites hosted by the Foundation including Wikipedia, Wiktionary, Wikimedia Commons, Wikiquote, Meta-Wiki and Wikidata, which define a large part of the set requirements for the software. MediaWiki is written in the PHP programming language and stores all text content into a database. The software is optimized to efficiently handle large projects, which can have terabytes of content and hundreds of thousands of views per second. Because Wikipedia is one of the world's largest and most visited websites, achieving scalability through multiple layers of caching and database replication has been a major concern for developers. Another major aspect of MediaWiki is its internationalization; its interface is available in more than 400 languages. The software has more than 1,000 configuration settings and more than 1,800 extensions available for enabling various features to be added or changed. Besides its usage on Wikimedia sites, MediaWiki has been used as a knowledge management and content management system on websites such as Fandom, wikiHow and major internal installations like Intellipedia and Diplopedia.

Question answering (QA) is a computer science discipline within the fields of information retrieval and natural language processing (NLP) that is concerned with building systems that automatically answer questions that are posed by humans in a natural language.

<span class="mw-page-title-main">Wikisource</span> Free online library on a wiki

Wikisource is an online digital library of free-content textual sources on a wiki, operated by the Wikimedia Foundation. Wikisource is the name of the project as a whole and the name for each instance of that project ; multiple Wikisources make up the overall project of Wikisource. The project's aim is to host all forms of free text, in many languages, and translations. Originally conceived as an archive to store useful or important historical texts, it has expanded to become a general-content library. The project officially began on November 24, 2003, under the name Project Sourceberg, a play on the famous Project Gutenberg. The name Wikisource was adopted later that year and it received its own domain name.

<span class="mw-page-title-main">Wikimedia movement</span> Group of global contributors to Wikimedia projects

The Wikimedia movement is the global community of contributors to the Wikimedia projects, including Wikipedia. This community directly builds and administers these projects with the commitment of achieving this using open standards and software.

<span class="mw-page-title-main">Latvian Wikipedia</span> Latvian-language edition of Wikipedia

The Latvian Wikipedia is the Latvian-language edition of the free online encyclopedia Wikipedia. It was created on 6 June 2003. With more than 126,000 articles, it is currently the 68th-largest Wikipedia as measured by the number of articles and the second-largest Wikipedia in a Baltic language after the Lithuanian Wikipedia.

Data exchange is the process of taking data structured under a source schema and transforming it into a target schema, so that the target data is an accurate representation of the source data. Data exchange allows data to be shared between different computer programs.

<span class="mw-page-title-main">DBpedia</span> Online database project

DBpedia is a project aiming to extract structured content from the information created in the Wikipedia project. This structured information is made available on the World Wide Web using OpenLink Virtuoso. DBpedia allows users to semantically query relationships and properties of Wikipedia resources, including links to other related datasets.

<span class="mw-page-title-main">Tagalog Wikipedia</span> Tagalog-language edition of the free online encyclopedia

The Tagalog Wikipedia is the Tagalog language edition of Wikipedia, which was launched on December 1, 2003. It has 46,599 articles and is the 102nd largest Wikipedia according to the number of articles as of February 23, 2024.

<span class="mw-page-title-main">Swedish Wikipedia</span> Swedish language edition of Wikipedia

The Swedish Wikipedia is the Swedish-language edition of Wikipedia and was started on the 23 of May 2001. It is currently the fifth largest Wikipedia by article count with its 2,576,872 current articles, it has a Wikipedia article depth of 17.47. A majority were generated by Lsjbot, a bot, or software application. The administrators on the Swedish Wikipedia are elected for a fixed-term period of one year and have to be re-elected after that time.

<span class="mw-page-title-main">Outline of Wikipedia</span> Overview of and topical guide to Wikipedia

The following outline is provided as an overview of and a topical guide to Wikipedia:

<span class="mw-page-title-main">Wikidata</span> Free knowledge database project

Wikidata is a collaboratively edited multilingual knowledge graph hosted by the Wikimedia Foundation. It is a common source of open data that Wikimedia projects such as Wikipedia, and anyone else, is able to use under the CC0 public domain license. Wikidata is a wiki powered by the software MediaWiki, including its extension for semi-structured data, the Wikibase.

Deep Linguistic Processing with HPSG - INitiative (DELPH-IN) is a collaboration where computational linguists worldwide develop natural language processing tools for deep linguistic processing of human language. The goal of DELPH-IN is to combine linguistic and statistical processing methods in order to computationally understand the meaning of texts and utterances.

<span class="mw-page-title-main">BabelNet</span> Multilingual semantic network and encyclopedic dictionary

BabelNet is a multilingual lexicalized semantic network and ontology developed at the NLP group of the Sapienza University of Rome. BabelNet was automatically created by linking Wikipedia to the most popular computational lexicon of the English language, WordNet. The integration is done using an automatic mapping and by filling in lexical gaps in resource-poor languages by using statistical machine translation. The result is an encyclopedic dictionary that provides concepts and named entities lexicalized in many languages and connected with large amounts of semantic relations. Additional lexicalizations and definitions are added by linking to free-license wordnets, OmegaWiki, the English Wiktionary, Wikidata, FrameNet, VerbNet and others. Similarly to WordNet, BabelNet groups words in different languages into sets of synonyms, called Babel synsets. For each Babel synset, BabelNet provides short definitions in many languages harvested from both WordNet and Wikipedia.

translatewiki.net, formerly named Betawiki, is a web-based translation platform powered by the Translate extension for MediaWiki. It can be used to translate various kinds of texts but is commonly used for creating localisations for software interfaces.

<span class="mw-page-title-main">Volapük Wikipedia</span> Volapük-language edition of Wikipedia

The Volapük Wikipedia is the Volapük-language edition of the free online encyclopedia Wikipedia. It was created in February 2003, but launched in January 2004. As of 22 February 2024, it is the 108th-largest Wikipedia as measured by the number of articles, with about 36,000 articles, and the second-largest Wikipedia in a constructed language after the Esperanto Wikipedia.

UBY is a large-scale lexical-semantic resource for natural language processing (NLP) developed at the Ubiquitous Knowledge Processing Lab (UKP) in the department of Computer Science of the Technische Universität Darmstadt . UBY is based on the ISO standard Lexical Markup Framework (LMF) and combines information from several expert-constructed and collaboratively constructed resources for English and German.

References

Citations

  1. 1 2 Wikimedia's MediaWiki API:Sitematrix. Retrieved February2024 from Data:Wikipedia statistics/meta.tab
  2. "Wikipedia mailing list archive discussion announcing the opening of the Wiktionary project". December 12, 2002. Archived from the original on June 20, 2014. Retrieved May 3, 2011.
  3. Wikipedia mailing list archive discussion from Larry Sanger giving the idea on Wiktionary Archived June 20, 2014, at the Wayback Machine – Retrieved May 3, 2011
  4. "Wiktionary". www.wiktionary.org. Archived from the original on September 13, 2008. Retrieved October 28, 2021.
  5. TheDaveBot Archived October 11, 2007, at the Wayback Machine , TheCheatBot Archived October 11, 2007, at the Wayback Machine , Websterbot Archived October 11, 2007, at the Wayback Machine , PastBot Archived October 11, 2007, at the Wayback Machine , NanshuBot Archived October 11, 2007, at the Wayback Machine
  6. Detailed statistics Archived July 23, 2021, at the Wayback Machine as of July 21, 2021
  7. "LXbot". Archived from the original on May 24, 2008.
  8. "Wiktionary:Statistics". March 29, 2022. Archived from the original on March 6, 2023. Retrieved March 6, 2023 via Wiktionary.
  9. "Wiktionary talk:Wiktionary Logo", English Wiktionary, Wikimedia Foundation.
  10. "Wiktionary/logo/refresh/voting", Meta-Wiki, Wikimedia Foundation.
  11. phab:T139255
  12. m:Wiktionary/logo#Logo use statistics.
  13. 1 2 3 Wikimedia's MediaWiki API:Siteinfo. Retrieved February2024 from Data:Wikipedia statistics/data.tab
  14. "Wiktionary Statistics". Meta.Wikimedia.org . Archived from the original on September 2, 2020. Retrieved September 11, 2020.
  15. Lepore 2006.
  16. David Brooks, "Online, interactive encyclopedia not just for geeks anymore, because everyone seems to need it now, more than ever!" The Nashua Telegraph (August 4, 2004)
  17. Kurmas 2010.
  18. Sascha & Müller-Spitzer 2016 , p. 348
  19. Meyer & Gurevych 2012, p. 140.
  20. Zesch, Müller & Gurevych 2008, p. 4, Figure 1.
  21. Meyer & Gurevych 2010, p. 40.
  22. Krizhanovsky, Transformation 2010, p. 1.
  23. Hellmann & Auer 2013, p. 302, p. 16 in PDF.
  24. Hellmann, Brekle & Auer 2012, p. 3, Table 1.
  25. "DBpedia Wiktionary". Archived from the original on May 4, 2013.
  26. Hellmann, Brekle & Auer 2012, pp. 8–9.
  27. Hellmann, Brekle & Auer 2012, p. 10.
  28. Hellmann, Brekle & Auer 2012, p. 11.
  29. "Welcome". DKPro JWKTL. Archived from the original on January 23, 2021. Retrieved June 23, 2019.
  30. Zesch, Müller & Gurevych 2008.
  31. "Wikokit - Machine-readable Wiktionary". December 19, 2022. Archived from the original on October 2, 2020. Retrieved November 7, 2015 via GitHub.
  32. Krizhanovsky, Transformation 2010.
  33. 1 2 Smirnov et al. 2012.
  34. Krizhanovsky, Comparison 2010.
  35. "Gerard de Melo's Research at ICSI, Berkeley". gerard.demelo.org. Archived from the original on March 27, 2023. Retrieved March 6, 2023.
  36. Otte & Tyers 2011.
  37. McFate & Forbus 2011.
  38. Schlippe, Ochs & Schultz 2012.
  39. Schlippe, Ochs & Schultz 2012, p. 4802.
  40. Schlippe, Ochs & Schultz 2012, p. 4804.
  41. Meyer & Gurevych 2012.
  42. "ConceptNet 5". conceptnet5.media.mit.edu. Archived from the original on October 19, 2011. Retrieved September 23, 2023.
  43. Lin & Krizhanovsky 2011.
  44. Medero & Ostendorf 2009.
  45. Li, Graça & Taskar 2012.
  46. Chesley et al. 2006.
  47. "Wikidata:Wiktionary". Archived from the original on January 3, 2023. Retrieved October 12, 2012.

Sources

  • Krizhanovsky, Andrew (2010). "Transformation of Wiktionary entry structure into tables and relations in a relational database schema". arXiv: 1011.1368 [cs].
  • Krizhanovsky, Andrew (2010). "The comparison of Wiktionary thesauri transformed into the machine-readable format". arXiv: 1006.5040 [cs].
  • Li, Shen; Graça, Joao V.; Taskar, Ben (2012). "Wiki-ly supervised part-of-speech tagging" (PDF). Proceedings of the 2012 Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. Jeju Island, Korea: Association for Computational Linguistics. pp. 1389–1398. Archived from the original (PDF) on May 22, 2013. Retrieved May 10, 2013.
  • Lin, Feiyu; Krizhanovsky, Andrew (2011). "Multilingual ontology matching based on Wiktionary data accessible via SPARQL endpoint". Proc. of the 13th Russian Conference on Digital Libraries RCDL'2011. Voronezh, Russia. pp. 19–26. arXiv: 1109.0732 . Bibcode:2011arXiv1109.0732L.
  • McFate, Clifton J.; Forbus, Kenneth D. (2011). "NULEX: an open-license broad coverage lexicon" (PDF). The 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, Proceedings of the Conference. Portland, Oregon, USA: The Association for Computer Linguistics. pp. 363–367. ISBN   978-1-932432-88-6.
  • "Wiktionary". Top 101 Web Sites. PC Magazine. Ziff Davis. April 6, 2005. Archived from the original on December 21, 2005. Retrieved December 16, 2005.