OLAC Record

Title:BOLT Information Retrieval Comprehensive Training and Evaluation
Access Rights:Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining
Bibliographic Citation:Griffitt, Kira, and Stephanie Strassel. BOLT Information Retrieval Comprehensive Training and Evaluation LDC2018T18. Web Download. Philadelphia: Linguistic Data Consortium, 2018
Contributor:Griffitt, Kira
Strassel, Stephanie
Date (W3CDTF):2018
Date Issued (W3CDTF):2018-09-17
Description:*Introduction* BOLT Information Retrieval Comprehensive Training and Evaluation was developed by the Linguistic Data Consortium (LDC) and consists of all data produced in support of the Information Retrieval (IR) task within the DARPA Broad Operational Language Translation (BOLT) Program, including annotations, source documents and scoring software. The BOLT program developed machine translation and information retrieval for less formal genres, focusing particularly on user-generated content. LDC supported BOLT by collecting informal data sources -- discussion forums, text messaging and chat -- in Chinese, Egyptian Arabic and English. The collected data was translated and annotated for various tasks including word alignment, treebanking, propbanking and co-reference. The material in this release relates to the IR task, which sought to support development of systems that could: (1) take as input a natural language English query sentence; (2) return relevant responses to that query from a large corpus of informal documents in the three BOLT languages (Arabic, Chinese, and English); and (3) translate responses from non-English documents into English. *Data* BOLT Information Retrieval Comprehensive Training and Evaluation contains the pilot, dry run, and evaluation data developed for each phase of the BOLT IR task, including: (1) natural-language IR queries, system responses to queries, and manually-generated assessment judgments for system responses; (2) discussion forum source documents in Arabic, Chinese and English; (3) scoring software for each evaluation phase; and (4) experimental data developed in Phase 2. Source data is presented as a series of zip archives containing xml files. Queries and responses data are presented as XML as well. Judgments are included as tab delimited files. *Acknowledgement* This material is based upon work supported by the Defense Advanced Research Projects Agency (DARPA) under Contract No. HR0011-11-C-0145. The content does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred. *Samples* Please view the following samples: * Source Data * Query * Assessment * Response Assessment *Updates* None at this time.
Extent:Corpus size: 7743680 KB
ISBN: 1-58563-855-2
ISLRN: 384-402-057-006-6
DOI: 10.35111/sd50-6m36
Language:Egyptian Arabic
Mandarin Chinese
Language (ISO639):arz
License:LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf
Medium:Distribution: Web Download
Publisher:Linguistic Data Consortium
Publisher (URI):https://www.ldc.upenn.edu
Relation (URI):https://catalog.ldc.upenn.edu/docs/LDC2018T18
Rights Holder:Portions © 2012-2016, 2018 Trustees of the University of Pennsylvania
Type (DCMI):Text
Type (OLAC):primary_text


Archive:  The LDC Corpus Catalog
Description:  http://www.language-archives.org/archive/www.ldc.upenn.edu
GetRecord:  OAI-PMH request for OLAC format
GetRecord:  Pre-generated XML file

OAI Info

OaiIdentifier:  oai:www.ldc.upenn.edu:LDC2018T18
DateStamp:  2020-11-30
GetRecord:  OAI-PMH request for simple DC format

Search Info

Citation: Griffitt, Kira; Strassel, Stephanie. 2018. Linguistic Data Consortium.
Terms: area_Africa area_Asia area_Europe country_CN country_EG country_GB dcmi_Text iso639_arz iso639_cmn iso639_eng olac_primary_text

Up-to-date as of: Sun Sep 10 0:41:20 EDT 2023