CorCenCC

Last updated
CorCenCC Project and Corpus Logo Corcencc icon 12 a high res.png
CorCenCC Project and Corpus Logo

CorCenCC or (Welsh: Corpws Cenedlaethol Cymraeg Cyfoes) the National Corpus of Contemporary Welsh is a language resource for Welsh speakers, Welsh learners, Welsh language researchers, and anyone who is interested in the Welsh language. CorCenCC is a freely accessible collection of multiple language samples, gathered from real-life communication, and presented in the searchable online CorCenCC text corpus. The corpus is accompanied by an online teaching and learning toolkit – Y Tiwtiadur [1] – which draws directly on the data from the corpus to provide resources for Welsh language learning at all ages and levels.

Contents

Launched in September 2020, CorCenCC is the first corpus of the Welsh language that includes all three aspects of contemporary Welsh: spoken, written and electronically mediated (e-language).

Composition

CorCenCC extends to 11 million words of naturally occurring Welsh language (note: the version of the corpus available on the CorCenCC website reports results in tokens rather than words). The creation of CorCenCC was a community-driven project, which offered users of Welsh an opportunity to contribute to a Welsh language resource that reflects how Welsh is currently used. The dataset, therefore, offers a snapshot of the Welsh language across a range of contexts of use, e.g. private conversations, group socialising, business and other work situations, in education, in the various published media, and in public spaces. A full list of contexts, genres and topics included are available on the project's website.

Conversations were recorded by the research team, and a crowdsourcing app enabled Welsh speakers in the community to record and upload samples of their own language use to the corpus. The published CorCenCC corpus was sampled from a range of different speakers and users of Welsh, from all regions of Wales, of all ages and genders, with a wide range of occupations, and with a variety of linguistic backgrounds (e.g. how they came to speak Welsh), to reflect the diversity of text types and of Welsh speakers found in contemporary Wales. [2]

Tools

Funding

The research on which CorCenCC project was based was funded by the UK Economic and Social Research Council (ESRC) and Arts and Humanities Research Council (AHRC) as "Corpws Cenedlaethol Cymraeg Cyfoes (The National Corpus of Contemporary Welsh): A community driven approach to linguistic corpus construction project" (Grant Number ES/M011348/1).

Related Research Articles

Welsh language Brythonic language spoken natively in Wales

Welsh is a Brittonic language of the Celtic language family that is native to the Welsh people. Welsh is spoken natively in Wales, by some in England, and in Y Wladfa. Historically, it has also been known in English as "British", "Cambrian", "Cambric" and "Cymric".

Corpus linguistics is the study of language as a language is expressed in its text corpus, its body of "real world" text. Corpus linguistics proposes that reliable language analysis is more feasible with corpora collected in the field in its natural context ("realia"), and with minimal experimental interference.

In linguistics, a corpus or text corpus is a language resource consisting of a large and structured set of texts. In corpus linguistics, they are used to do statistical analysis and hypothesis testing, checking occurrences or validating linguistic rules within a specific language territory.

In corpus linguistics, part-of-speech tagging, also called grammatical tagging is the process of marking up a word in a text (corpus) as corresponding to a particular part of speech, based on both its definition and its context. A simplified form of this is commonly taught to school-age children, in the identification of words as nouns, verbs, adjectives, adverbs, etc.

The Brown University Standard Corpus of Present-Day American English is an electronic collection of text samples of American English, the first major structured corpus of varied genres. This corpus first set the bar for the scientific study of the frequency and distribution of word categories in everyday language use. Compiled by Henry Kučera and W. Nelson Francis at Brown University, in Rhode Island, it is a general language corpus containing 500 samples of English, totaling roughly one million words, compiled from works published in the United States in 1961.

The American National Corpus (ANC) is a text corpus of American English containing 22 million words of written and spoken data produced since 1990. Currently, the ANC includes a range of genres, including emerging genres such as email, tweets, and web data that are not included in earlier corpora such as the British National Corpus. It is annotated for part of speech and lemma, shallow parse, and named entities.

Treebank

In linguistics, a treebank is a parsed text corpus that annotates syntactic or semantic sentence structure. The construction of parsed corpora in the early 1990s revolutionized computational linguistics, which benefitted from large-scale empirical data. The exploitation of treebank data has been important ever since the first large-scale treebank, The Penn Treebank, was published. However, although originating in computational linguistics, the value of treebanks is becoming more widely appreciated in linguistics research as a whole. For example, annotated treebank data has been crucial in syntactic research to test linguistic theories of sentence structure against large quantities of naturally occurring examples.

Geoffrey Neil Leech FBA was a specialist in English language and linguistics. He was the author, co-author, or editor of over 30 books and over 120 published papers. His main academic interests were English grammar, corpus linguistics, stylistics, pragmatics, and semantics.

The British National Corpus (BNC) is a 100-million-word text corpus of samples of written and spoken English from a wide range of sources. The corpus covers British English of the late 20th century from a wide variety of genres, with the intention that it be a representative sample of spoken and written British English of that time.

Linguistic categories include

The knowledge acquisition bottleneck is perhaps the major impediment to solving the word sense disambiguation (WSD) problem. Unsupervised learning methods rely on knowledge about word senses, which is barely formulated in dictionaries and lexical databases. Supervised learning methods depend heavily on the existence of manually annotated examples for every word sense, a requisite that can so far be met only for a handful of words for testing purposes, as it is done in the Senseval exercises.

Deep Linguistic Processing with HPSG - INitiative (DELPH-IN) is a collaboration where computational linguists worldwide develop natural language processing tools for deep linguistic processing of human language. The goal of DELPH-IN is to combine linguistic and statistical processing methods in order to computationally understand the meaning of texts and utterances.

The Spoken English Corpus (SEC) is a speech corpus collection of recordings of spoken British English compiled during 1984-7. The corpus manual can be found on ICAME.

The Bulgarian Sense-annotated Corpus (BulSemCor) is a structured corpus of Bulgarian texts in which each lexical item is assigned a sense tag. BulSemCor was created by the Department of Computational Linguistics at the Institute for Bulgarian Language of the Bulgarian Academy of Sciences.

The Bulgarian National Corpus (BulNC) is a large representative corpus of Bulgarian comprising about 200,000 texts and amounting to over 1 billion words.

Manually Annotated Sub-Corpus (MASC) is a balanced subset of 500K words of written texts and transcribed speech drawn primarily from the Open American National Corpus (OANC). The OANC is a 15 million word corpus of American English produced since 1990, all of which is in the public domain or otherwise free of usage and redistribution restrictions.

Drama annotation is the process of annotating the metadata of a drama. Given a drama expressed in some medium, the process of metadata annotation identifies what are the elements that characterize the drama and annotates such elements in some metadata format. For example, in the sentence "Laertes and Polonius warn Ophelia to stay away from Hamlet." from the text Hamlet, the word "Laertes", which refers to a drama element, namely a character, will be annotated as "Char", taken from some set of metadata. This article addresses the drama annotation projects, with the sets of metadata and annotations proposed in the scientific literature, based markup languages and ontologies.

In linguistics and language technology, a language resource is a "[composition] of linguistic material used in the construction, improvement and/or evaluation of language processing applications, (...) in language and language-mediated research studies and applications."

Kevin Scannell

Kevin Scannell is an American professor of mathematics and computer science at Saint Louis University.

References

  1. "Y Tiwtiadur – CorCenCC – National Corpus of Contemporary Welsh" . Retrieved 2020-09-18.
  2. 1 2 Neale, S.; Spasić, I.; Needs, J.; Watkins, G.; Morris, S.; Fitzpatrick, T.; Marshall, L.; Knight, D. (2017), "The CorCenCC crowdsourcing app: A bespoke tool for the user-driven creation of the national corpus of contemporary Welsh", Corpus Linguistics Conference 2017, Newcastle University
  3. Neale, S.; Donnelly, K.; Watkins, G.; Knight, D. (May 2018). "Leveraging Lexical Resources and Constraint Grammar for Rule-Based Part-of-Speech Tagging in Welsh". Poster presented at the LREC (Language Resources Evaluation) 2018 Conference. Miyazaki, Japan.CS1 maint: date and year (link)
  4. "UCREL Semantic Analysis System (USAS)". ucrel.lancs.ac.uk. Retrieved 2020-09-18.
  5. Piao, S.; Rayson, P.; Knight, D.; Watkins, G. (May 2018), "Towards a Welsh Semantic Annotation System", Proceedings of the LREC (Language Resources Evaluation) 2018 Conference, Miyazaki, JapanCS1 maint: date and year (link)
  6. Piao, S.; Rayson, P.; Knight, D.; Watkins, G.; Donnelly, K. (July 2017), "Towards a Welsh Semantic Tagger: Creating Lexicons for A Resource Poor Language", Proceedings of The Corpus Linguistics 2017 Conference, University of Birmingham, Birmingham, UKCS1 maint: date and year (link)
  7. Davies, J.; Thomas, E-M.; Fitzpatrick, T.; Needs, J.; Anthony, L.; Cobb, T.; Knight, D (2020). "Y Tiwtiadur. [Digital Resource]".
  8. Knight, D.; Loizides, F.; Neale, S.; Anthony, L.; Spasić, I. (2020). "Developing computational infrastructure for the CorCenCC corpus: The National Corpus of Contemporary Welsh". Language Resources and Evaluation: 1–28. doi: 10.1007/s10579-020-09501-9 .