OLAC Record

Title:Package of word embeddings of Czech from a large corpus
Bibliographic Citation:http://hdl.handle.net/11234/1-4920
Creator:Kyjánek, Lukáš
Bonami, Olivier
Date (W3CDTF):2022-11-11T09:25:05Z
Date Available:2022-11-11T09:25:05Z
Description:This package comprises eight models of Czech word embeddings trained by applying word2vec (Mikolov et al. 2013) to the currently most extensive corpus of Czech, namely SYN v9 (Křen et al. 2022). The minimum frequency threshold for including a word in the model was 10 occurrences in the corpus. The original lemmatisation and tagging included in the corpus were used for disambiguation. In the case of word embeddings of word forms, units comprise word forms and their tag from a positional tagset (cf. https://wiki.korpus.cz/doku.php/en:pojmy:tag) separated by '>', e.g., kočka>NNFS1-----A----. The published package provides models trained on both tokens and lemmas. In addition, the models combine training algorithms (CBOW and Skipgram) and dimensions of the resulting vectors (100 or 500), while the training window and negative sampling remained the same during the training. The package also includes files with frequencies of word forms (vocab-frequencies.forms) and lemmas (vocab-frequencies.lemmas).
Identifier (URI):http://hdl.handle.net/11234/1-4920
Language (ISO639):ces
Publisher:Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)
Rights:Creative Commons - Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0)
Subject:word embeddings
word vectors
large corpus
Czech language
Subject (ISO639):ces
Type (DCMI):Text
Type (OLAC):lexicon


Archive:  LINDAT/CLARIAH-CZ digital library at the Institute of Formal and Applied Linguistics (ÚFAL), Faculty of Mathematics and Physics, Charles University
Description:  http://www.language-archives.org/archive/lindat.mff.cuni.cz
GetRecord:  OAI-PMH request for OLAC format
GetRecord:  Pre-generated XML file

OAI Info

OaiIdentifier:  oai:lindat.mff.cuni.cz:11234/1-4920
DateStamp:  2022-11-11
GetRecord:  OAI-PMH request for simple DC format

Search Info

Citation: Kyjánek, Lukáš; Bonami, Olivier. 2022. Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL).
Terms: area_Europe country_CZ dcmi_Text iso639_ces olac_lexicon

Inferred Metadata

Country: Czech Republic
Area: Europe

Up-to-date as of: Thu Oct 5 0:43:24 EDT 2023