OLAC Record

Title:Indian Language Part-of-Speech Tagset: Hindi
Access Rights:Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining
Bibliographic Citation:Bali, Kalika, et al. Indian Language Part-of-Speech Tagset: Hindi LDC2010T24. Web Download. Philadelphia: Linguistic Data Consortium, 2010
Contributor:Bali, Kalika
Choudhury, Monojit
Biswas, Priyanka
Girish Nath Jha
Narayan Kumar Choudhary
Sharma, Maansi
Date (W3CDTF):2010
Date Issued (W3CDTF):2010-12-20
Description:*Introduction* Indian Language Part-of-Speech Tagset: Hindi was developed by Microsoft Research (MSR) India to support the task of Part-of-Speech Tagging (POS) and other data-driven linguistic research on Indian Languages in general. It was created as a part of the Indian Language Part-of-Speech Tagset (IL-POST) project, a collaborative effort among linguists and computer scientists from MSR India, AU-KBC (Anna University, Chennai), Delhi University, IIT Bombay, Jawaharlal Nehru University (Delhi) and Tamil University (Tamilnadu). The goal of the IL-POST project is to provide a common tagset framework for Indian Languages that offers flexibility, cross-linguistic compatibility and reusability across those languages. It supports a three-level hierarchy of Categories, Types and Attributes. The corpus mainly consists therefore of two different levels of information for each lexical token: (a) lexical Category and Types, and (b) set morphological attributes and their associated values in the context. Hindi is the official language of India and a member of the Indo-Aryan language group. It is spoken mainly in the northern states of Rajasthan, Delhi, Haryana, Uttarakhand, Uttar Pradesh, Madhya Pradesh, Chhattisgarh, Himachal Pradesh, Jharkhand and Bihar as well as in much of central India and in communities in Africa, Australia, New Zealand, the Middle East, Europe and North America. Hindi is the first or second language of more than 500 million people. *Data* This corpus contains 4859 sentences (98,450 words) of manually annotated Hindi text randomly collected from the Microsoft Hindi Research Corpus, sourced from the publisher WebDunia. All annotated data is provided in both xml and text files. The xml files are contained in the "XML_files" folder and the text files in the "text_files" folder. Each data file contains between 900-5,000 words. The XML file contains metadata about the material, such as language, encoding and data size. *Annotation Procedure* The Annotation Guidelines for Hindi, included in this release, contain a detailed description of the annotation methodology. The Annotation Tool Guideline 1.0, also included in this publication, describes the annotation interface developed for the IL-POST framework; the tool is not included in this corpus. *Updates* Additional information, updates, bug fixes may be available in the LDC catalog entry for this corpus at LDC2010T24. *Samples*
Extent:Corpus size: 7198 KB
ISBN: 1-58563-571-5
ISLRN: 115-406-051-155-7
DOI: 10.35111/bpb8-ew63
Language (ISO639):hin
License:Microsoft Research India License Agreement: https://catalog.ldc.upenn.edu/license/microsoft-research-india-license-agreement.pdf
Medium:Distribution: Web Download
Publisher:Linguistic Data Consortium
Publisher (URI):https://www.ldc.upenn.edu
Relation (URI):https://catalog.ldc.upenn.edu/docs/LDC2010T24
Rights Holder: Portions © 2010 Microsoft Research Labs India, Pvt. Ltd., © 2010 Trustees of the University of Pennsylvania
Type (DCMI):Text
Type (OLAC):primary_text


Archive:  The LDC Corpus Catalog
Description:  http://www.language-archives.org/archive/www.ldc.upenn.edu
GetRecord:  OAI-PMH request for OLAC format
GetRecord:  Pre-generated XML file

OAI Info

OaiIdentifier:  oai:www.ldc.upenn.edu:LDC2010T24
DateStamp:  2024-03-06
GetRecord:  OAI-PMH request for simple DC format

Search Info

Citation: Bali, Kalika; Choudhury, Monojit; Biswas, Priyanka; Girish Nath Jha; Narayan Kumar Choudhary; Sharma, Maansi. 2010. Linguistic Data Consortium.
Terms: area_Asia country_IN dcmi_Text iso639_hin olac_primary_text

Up-to-date as of: Sun Jun 16 7:34:17 EDT 2024