OLAC Record
oai:www.ldc.upenn.edu:LDC2008T09

Metadata
Title:GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2
Access Rights:Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining
Bibliographic Citation:Ma, Xiaoyi, Dalal Zakhary, and Stephanie Strassel. GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2 LDC2008T09. Web Download. Philadelphia: Linguistic Data Consortium, 2008
Contributor:Ma, Xiaoyi
Zakhary, Dalal
Strassel, Stephanie
Date (W3CDTF):2008
Date Issued (W3CDTF):2008-06-16
Description:*Introduction* GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2 is the second of the three-part GALE Phase 1 Arabic Broadcast News Parallel Text, which, along with other corpora, was used as training data in year 1 (Phase 1) of the DARPA-funded GALE program. GALE Phase 1 Arabic Broadcast News Parallel Text - Part 1 was released in 2007. GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2 contains transcripts and English translations of 10.7 hours of Arabic broadcast news programming selected from various sources. This corpus does not contain the audio files from which the transcripts and translations were generated. LDC has released the following GALE Phase 1 & 2 Arabic Parallel Text data sets: * GALE Phase 1 Arabic Broadcast News Parallel Text - Part 1 (LDC2007T24) * GALE Phase 1 Arabic Broadcast News Parallel Text - Part 2 (LDC2008T09) * GALE Phase 1 Arabic Blog Parallel Text (LDC2008T02) * GALE Phase 1 Arabic Newsgroup Parallel Text - Part 1 (LDC2009T03) * GALE Phase 1 Arabic Newsgroup Parallel Text - Part 2 (LDC2009T09) * GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 1 (LDC2012T06) * GALE Phase 2 Arabic Broadcast Conversation Parallel Text Part 2 (LDC2012T14) * GALE Phase 2 Arabic Newswire Parallel Text (LDC2012T17) * GALE Phase 2 Arabic Broadcast News Parallel Text (LDC2012T18) * GALE Phase 2 Arabic Web Parallel Text (LDC2013T01) *Source Data* A total of 10.7 hours of Arabic broadcast news recordings were selected from four sources and four different programs. A manual selection procedure was used to choose data appropriate for the GALE program, namely, news and conversation programs focusing on current events. Stories on topics such as sports, entertainment news, and stock market reports were excluded from the data set. The following table is a summary of the files included in this release. Source Program Epoch (YYYY.MM) #hours #words Dubai TV Dubai News 2005.02 - 2005.12 2.0 11,078 Nile TV News 2000.11 - 2000.12 0.5 3,079 Radio Sawa News at 06:00 2005.11 2.8 9,712 Voice of America News 2000.11 - 2001.03 5.4 32,305 *Transcription* The selected audio files were carefully transcribed by LDC annotators and professional transcription agencies following LDC's Quick Rich Transcription specification. Manual sentence units/segments (SU) annotation was also performed as part of the transcription task. Three types of end of sentence SU are identified: - statement SU - question SU - incomplete SU *Translation* After transcription and SU annotation, files were reformatted into a human-readable translation format and were assigned to professional translators for careful translation. Translators followed LDC's GALE Translation guidelines, which describe the makeup of the translation team, the source data format, the translation data format, best practices for translating certain linguistic features (such as names and speech disfluencies), and quality control procedures applied to completed translations. *Final Data* TDF Format All final data are in Tab Delimited Format (TDF). TDF is compatible with other transcription formats, such as Transcriber format and AG format, and it is easy to process. Each line of a TDF file corresponds to a speech segment and contains 13 tab delimited fields (the 13th field "suType" might be empty): field data_type ----- --------- 1 file unicode 2 channel int 3 start float 4 end float 5 speaker unicode 6 speakerType unicode 7 speakerDialect unicode 8 transcript unicode 9 section int 10 turn int 11 segment int 12 sectionType unicode 13 suType unicode A source TDF file and its translation are the same except that the transcript in the source TDF is replaced by its English translation. Encoding All data are encoded in UTF8. *Sponsorship* This work was supported in part by the Defense Advanced Research Projects Agency, GALE Program Grant No. HR0011-06-1-0003. The content of this publication does not necessarily reflect the position or the policy of the Government, and no official endorsement should be inferred. *Samples* For an example of the data in this corpus, please examine these screen captures of the source and translation.
Extent:Corpus size: 4812 KB
Identifier:LDC2008T09
https://catalog.ldc.upenn.edu/LDC2008T09
ISBN: 1-58563-479-4
ISLRN: 466-566-464-744-9
DOI: 10.35111/1nb0-3e87
Language:English
Standard Arabic
Language (ISO639):eng
arb
License:LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf
Medium:Distribution: Web Download
Publisher:Linguistic Data Consortium
Publisher (URI):https://www.ldc.upenn.edu
Relation (URI):https://catalog.ldc.upenn.edu/docs/LDC2008T09
Rights Holder:Portions © 2005 Dubai TV, © 2000 Nile TV, © 2005-2007, 2008 Trustees of the University of Pennsylvania
Type (DCMI):Text
Type (OLAC):primary_text

OLAC Info

Archive:  The LDC Corpus Catalog
Description:  http://www.language-archives.org/archive/www.ldc.upenn.edu
GetRecord:  OAI-PMH request for OLAC format
GetRecord:  Pre-generated XML file

OAI Info

OaiIdentifier:  oai:www.ldc.upenn.edu:LDC2008T09
DateStamp:  2020-11-30
GetRecord:  OAI-PMH request for simple DC format

Search Info

Citation: Ma, Xiaoyi; Zakhary, Dalal; Strassel, Stephanie. 2008. Linguistic Data Consortium.
Terms: area_Asia area_Europe country_GB country_SA dcmi_Text iso639_arb iso639_eng olac_primary_text


http://www.language-archives.org/item.php/oai:www.ldc.upenn.edu:LDC2008T09
Up-to-date as of: Thu Oct 24 7:30:21 EDT 2024