oai:www.ldc.upenn.edu:LDC2005T16
| |
OLAC Record oai:www.ldc.upenn.edu:LDC2005T16 |
| Metadata | ||
| Title: | TDT4 Multilingual Text and Annotations | |
| Access Rights: | Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining | |
| Bibliographic Citation: | Strassel, Stephanie, Junbo Kong, and David Graff. TDT4 Multilingual Text and Annotations LDC2005T16. Web Download. Philadelphia: Linguistic Data Consortium, 2005 | |
| Contributor: | Strassel, Stephanie | |
| Kong, Junbo | ||
| Graff, David | ||
| Date (W3CDTF): | 2005 | |
| Date Issued (W3CDTF): | 2005-05-15 | |
| Description: | *Introduction* TDT4 Multilingual Text and Annotations was developed by the Linguistic Data Consortium (LDC) with support from the DARPA TIDES (Translingual Information Detection, Extraction, and Summarization) Program. This release contains the complete set of English, Arabic, and Chinese news text (broadcast news transcripts and newswire data, approximately 100,000 documents, 91,000 being news stories) used in the 2002 and 2003 Topic Detection and Tracking (TDT) technology evaluations, along with approximately 114,000 topic annotations created for those evaluations. The audio corresponding to the broadcast news transcripts in this release can be found in TDT4 Multilingual Broadcast News Speech Corpus (LDC2005S11). TDT refers to automatic techniques for finding topically related material in streams of data such as newswire and broadcast news. Evaluation tasks in 2002 and 2003 included the segmentation of a news source into stories, the tracking of known topics, the detection of unknown topics, the detection of initial stories on unknown topics, and the detection of pairs of stories on the same topic. *Data* The TDT4 corpus contains news data collected daily from 20 news sources in three languages over a period of four months (October 2000 through January 2001). Multiple manual annotations have been applied to the TDT4 data. Briefly, these include: * Transcription of audio data * Manual segmentation of audio data into individual story units and time * Alignment of audio with transcripts * Topic selection * Topic definition and research * Search guided topic relevance annotation * Adjudication of relevance judgments against system output The news stories are presented in multiple formats, including TIPSTER-style SGML formatting, individually separated tokens, and machine translation and automatic speech recognition outputs. There are also files showing topic relevance decisions for each news story. *Samples* For an example of the data in this corpus, please view this sample (TXT). This sample is an English translation from an Arabic news broadcast. The translation is the product of the IBM Arabic to English translation engine. *Updates* None at this time. | |
| Extent: | Corpus size: 3670016 KB | |
| Identifier: | LDC2005T16 | |
| https://catalog.ldc.upenn.edu/LDC2005T16 | ||
| ISBN: 1-58563-339-9 | ||
| ISLRN: 114-628-220-295-1 | ||
| DOI: 10.35111/9130-0z09 | ||
| Language: | English | |
| Standard Arabic | ||
| Mandarin Chinese | ||
| Language (ISO639): | eng | |
| arb | ||
| cmn | ||
| License: | LDC User Agreement for Non-Members: https://catalog.ldc.upenn.edu/license/ldc-non-members-agreement.pdf | |
| Medium: | Distribution: Web Download | |
| Publisher: | Linguistic Data Consortium | |
| Publisher (URI): | https://www.ldc.upenn.edu | |
| Relation (URI): | https://catalog.ldc.upenn.edu/docs/LDC2005T16 | |
| Rights Holder: | Portions © 2000-2001: Xinhua News Agency, Agence France Presse, New York Times, The Associated Press, SPH AsiaOne Ltd, An Nahar, Al Hayat, Nile TV, Public Radio International, Cable News Network, LP, LLP, American Broadcasting Company, National Broadcasting Company, Inc., China National Radio, China Television System, China Central TV, China Broadcasting System, © 2002, 2003, 2005 Trustees of the University of Pennsylvania The World is a co-production of Public Radio International and the British Broadcasting Corporation and is produced at WGBH Boston. | |
| Type (DCMI): | Text | |
| Type (OLAC): | primary_text | |
OLAC Info |
||
| Archive: | The LDC Corpus Catalog | |
| Description: | http://www.language-archives.org/archive/www.ldc.upenn.edu | |
| GetRecord: | OAI-PMH request for OLAC format | |
| GetRecord: | Pre-generated XML file | |
OAI Info |
||
| OaiIdentifier: | oai:www.ldc.upenn.edu:LDC2005T16 | |
| DateStamp: | 2021-11-12 | |
| GetRecord: | OAI-PMH request for simple DC format | |
Search Info | ||
| Citation: | Strassel, Stephanie; Kong, Junbo; Graff, David. 2005. Linguistic Data Consortium. | |
| Terms: | area_Asia area_Europe country_CN country_GB country_SA dcmi_Text iso639_arb iso639_cmn iso639_eng olac_primary_text | |