oai:www.ldc.upenn.edu:LDC2018T04
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2018T04 |
| Metadata | ||
| Title: | LORELEI Amharic Representative Language Pack - Monolingual and Parallel Text | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Tracey, Jennifer, et al. LORELEI Amharic Representative Language Pack - Monolingual and Parallel Text LDC2018T04. Web Download. Philadelphia: Linguistic Data Consortium, 2018 | |
| Contributor: | Tracey, Jennifer | |
| Graff, David | ||
| Strassel, Stephanie | ||
| Ma, Xiaoyi | ||
| Wright, Jonathan | ||
| Date (W3CDTF): | 2018 | |
| Date Issued (W3CDTF): | 2018-02-16 | |
| Description: | *Introduction* LORELEI Amharic Representative Language Pack - Monolingual and Parallel Text was developed by the Linguistic Data Consortium and is comprised of approximately 25 million words of monolingual Amharic text, approximately 600,000 of which are translated into English. Another 80,000 words are also translated from English into Amharic. The LORELEI (Low Resource Languages for Emergent Incidents) Program was concerned with building human language technology for low resource languages in the context of emergent situations like natural disasters or disease outbreaks. Linguistic resources for LORELEI include Representative Language Packs and Incident Language Packs for over two dozen low resource languages, comprising data, annotations, basic natural language processing tools, lexicons and grammatical resources. Representative languages were selected to provide broad typological coverage, while incident languages were selected to evaluate system performance on a language whose identity was disclosed at the start of the evaluation. *Data* Data was collected in the following genres: discussion forums, news, reference, social network and weblog. Both monolingual text collection and parallel text creation involved a combination of manual and automatic methods, which are detailed in the included documentation. All harvested content was initially converted from its original HTML form into a relatively uniform XML format. XML data is presented in two formats: a "homogenized" XML format that preserves the minimum set of tags needed to represent the structure of the relevant text as seen by the human web-page reader and a fully segmented and tokenized version of the text. All text data is encoded as UTF-8. Also included in this release are two tools: one to recreate original source data from the processed XML material and the other to condition text data users download from Twitter. *Acknowledgement* This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-15-C-0123. Any opinions, findings and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of DARPA. *Samples* Please view this Amharic sample and English translation sample. *Updates* None at this time. | |
| Extent: | Corpus size: 828728 KB | |
| Identifier: | LDC2018T04 | |
| https://catalog.ldc.upenn.edu/LDC2018T04 | ||
| ISBN: 1-58563-835-8 | ||
| ISLRN: 494-818-599-171-5 | ||
| DOI: 10.35111/6pzy-pq94 | ||
| Language: | Amharic | |
| English | ||
| Language (ISO639): | amh | |
| eng | ||
| License: | LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2018T04 | |
| Rights Holder: | Portions © 2015 Abbay Media 'The Ethiopian Information Bank', © 2011-2016 Addis Admass, © 2016 Addis Dimts Radio, © 2015-2016 Addis Media,© 2002-2007, 2009-2010 Agence France Presse, © 2000, 2001 American Broadcasting Company, © 2015 Awramba Times, © 2000 Cable News Network, LP, LLLP, © 2008 Central News Agency (Taiwan), © 2006 Dow Jones & Company, Inc., © 2015-2016 ECADF Ethiopian News, © 2015 Ethio Andinet, © 2016 Ethiopian Broadcasting Corporation, © 2016 Ethiopian Press Agency, © 2015 Ethiopia Prosperous, © 2015-2016 Ethiopian Reporter, © 2014, 2016 Ethiopian Satellite Television (ESAT), © 2016 Fana Broadcasting Corporate (FBC), © 2013-2016 Golgul, © 2012, 2014-2016 Government of Ethiopia, © 2014, 2016 Gudnew, © 2016 Henock Yared, © 2014 HornAffairs, © 2016 Kal Tube, © 2005-2006 Los Angeles Times - Washington Post News Service, Inc., © 2016 Mahibere Kidusan, © 2016 Mereja.com, © 2000 National Broadcasting Company, Inc., © 1999, 2005-2006, 2008 New York Times, © 2000 Public Radio International, © 2014-2016 Sendek NewsPaper, © 2015 Sheger FM 102.1, © 2015 Sodere, © 2003-2010 The Associated Press, © 2016 The Ethiopian News Agency, © 2007 The Ethiopianer, © 2015-2016 Tigray, © 2016 Walta Information Center, © 2016 Wazema Radio, © 2003, 2005-2008 Xinhua News Agency, © 2016 ZAMI, © 2013, 2015-2016 Zehabesha, © 2016, 2018 Trustees of the University of Pennsylvania | |
| Type (DCMI): | Software | |
| Text | ||
| Type (OLAC): | primary_text | |
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2018T04 | |
| DateStamp: | 2020-11-30 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Tracey, Jennifer; Graff, David; Strassel, Stephanie; Ma, Xiaoyi; Wright, Jonathan. 2018. Linguistic Data Consortium. | |
| Terms: | area_Africa area_Europe country_ET country_GB dcmi_Software dcmi_Text iso639_amh iso639_eng olac_primary_text | |