oai:www.ldc.upenn.edu:LDC2020T22
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2020T22 |
| Metadata | ||
| Title: | LORELEI Tigrinya Incident Language Pack | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Tracey, Jennifer, et al. LORELEI Tigrinya Incident Language Pack LDC2020T22. Web Download. Philadelphia: Linguistic Data Consortium, 2020 | |
| Contributor: | Tracey, Jennifer | |
| Graff, David | ||
| Strassel, Stephanie | ||
| Arrigo, Michael | ||
| Wright, Jonathan | ||
| Bies, Ann | ||
| Date (W3CDTF): | 2020 | |
| Date Issued (W3CDTF): | 2020-09-15 | |
| Description: | *Introduction* LORELEI Tigrinya Incident Language Pack was developed by the Linguistic Data Consortium and is comprised of approximately 4.5 million words of Tigrinya monolingual text, 25,000 words of English monolingual text, 235,000 words of parallel and comparable Tigrinya-English text, and 50,000 words of data annotated for Entity Detection and Linking and Situation Frames. It contains all of the text data, annotations, supplemental resources and related software tools for the Tigrinya language that were used in the DARPA LORELEI / LoReHLT 2017 Evaluation. The LORELEI (Low Resource Languages for Emergent Incidents) program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs and Incident Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources. Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation. The evaluation protocol was based on a scenario in which an unforeseen event triggered a need for humanitarian and logistical support in a region where the incident language had received little or no attention in natural language processing (NLP) research. Evaluation participants provided NLP solutions, including information extraction and machine translation, based on limited resources and with very little time for development. *Data* Tigrinya is spoken mainly in the Tigre region of Ethiopia and in Central Eritrea. Data was collected in the following genres: news, social network, weblog, newsgroup, discussion forum, and reference material. Entity detection and linking annotation identified entities to be detected by systems for scoring purposes. Situation frame analysis was designed to extract basic information about needs and relevant issues for planning a disaster response effort. Also included in this release are lexical and grammatical resources as well as three tools: two to recreate original source data from the processed XML material and the other to condition text data users download from Twitter. In addition to the standard LORELEI data for incident language packs, this corpus also features a small set of named entity and parallel text data from the 2007 DARPA REFLEX Language Pack for Tigrinya not previously released outside of the DARPA REFLEX program. Monolingual, parallel and comparable text are presented in XML with associated dtds. Entity Detection and Linking and Situation Frame annotation data is presented as tab delimited files. All text is UTF-8 encoded. The knowledge base for entity linking annotation for this corpus and all LORELEI Representative Language and Incident Language Packs is available separately as LORELEI Entity Detection and Linking Knowledge Base (LDC2020T10). *Acknowledgement* This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-15-C-0123. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DARPA. *Samples* Please view the following samples: * Tigrinya LTF XML * Tigrinya PSM XML * English A LTF XML * English A PSM XML * English B LTF XML * English B PSM XML * Entity Mention (TXT) * Issue Table (TXT) *Updates* None at this time. | |
| Extent: | Corpus size: 220579 KB | |
| Identifier: | LDC2020T22 | |
| https://catalog.ldc.upenn.edu/LDC2020T22 | ||
| ISBN: 1-58563-935-4 | ||
| ISLRN: 974-181-430-712-4 | ||
| DOI: 10.35111/gm1j-4r08 | ||
| Language: | Tigrinya | |
| English | ||
| Language (ISO639): | tir | |
| eng | ||
| License: | LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2020T22 | |
| Rights Holder: | Portions © 2004-2006 Adal.161.com, © 2015 Addis Standard Magazine, © 2003 Agence France Presse, © 2015-2016 Agroindustrial Association of Ukraine, © 2015-2016 Al Jazeera Media Network, © 2016 AllAfrica, © 2000 American Broadcasting Company, © 2005-2006, 2009-2016 Asmarino Independent, © 2009-2010 Assenna.com, © 2016 Associated Newspapers Limited, © 2003-2006 Awate.com, © 2016 BBC, © 2000 Cable News Network, LP, LLP, © 2016 Cable News Network. Turner Broadcasting System, Inc., © 2017 democrasia.org, © 2006 Dow Jones & Company, Inc., © 2004 Gabeel.net, © 2016 Geeskaafrika, © 2015 Guardian News & Media Limited or its affiliated companies, © 2006-2007 Haddas Ertra, © 2016 IPI International Peace Institute, © 2011, 2013-2105 Lac Viet Computing Corporation, © 2000 National Broadcasting Company, Inc., © 2004-2006 Nharnet.com, © 2000 Public Radio International, © 2015-2017 Radio Erena, © 2016 Reuters, © 2003 The Associated Press, © 2016-2017 The Migrant Project, © 2015 The New Humanitarian, © 2017 The Voice of the Tigray, © 2016 The Washington Post, © 2016 Tigraionline.com, © 2015 United Nations Office for the Coordination of Humanitarian Affairs, © 2017 Watch Tower Bible and Tract Society of Pennsylvania, © 2004-2006 www.degebat.com, © 2004-2006 www.hornofafrica.de, © 2003 Xinhua News Agency, © 2017, 2020 Trustees of the University of Pennsylvania | |
| Type (DCMI): | Software | |
| Text | ||
| Type (OLAC): | lexicon | |
| primary_text | ||
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2020T22 | |
| DateStamp: | 2023-01-27 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Tracey, Jennifer; Graff, David; Strassel, Stephanie; Arrigo, Michael; Wright, Jonathan; Bies, Ann. 2020. Linguistic Data Consortium. | |
| Terms: | area_Africa area_Europe country_ET country_GB dcmi_Software dcmi_Text iso639_eng iso639_tir olac_lexicon olac_primary_text | |