OLAC Record oai:www.ldc.upenn.edu:LDC2012T11

Metadata
Title:		American English Nickname Collection
Access Rights:		Licensing Instructions for Subscription & Standard Members, and Non-Members: http://www.ldc.upenn.edu/language-resources/data/obtaining
Bibliographic Citation:		Carvalho, Vitor R., Yigit Kiran, and Andrew Borthwick. American English Nickname Collection LDC2012T11. Web Download. Philadelphia: Linguistic Data Consortium, 2012
Contributor:		Carvalho, Vitor R.
		Kiran, Yigit
		Borthwick, Andrew
Date (W3CDTF):		2012
Date Issued (W3CDTF):		2012-07-18
Description:		*Introduction* American English Nickname Collection was developed by Intelius, Inc. and is a compilation of American English nicknames to given name mappings based on information in US government records, public web profiles and financial and property reports. This corpus is intended as a tool for the quantitative study of nickname usage in the United States such as in demographic and sociological studies. It has multiple potential human language technology applications as well, including entity extraction, coreference resolution, people search, language modeling and machine translation. *Data* The American English Nickname Collection contains 331,237 distinct mappings encompassing millions of names. The data was collected and processed through a record linkage pipeline. The steps in the pipeline were (1) data cleaning, (2) blocking, (3) pair-wise linkage and (4) clustering. In the cleaning step, material was categorized, processed to remove junk and spam records and normalized to an approximately common representation. The blocking process utitlized an algorithm to group records by shared properties for determining which record pairs should be examined by the pairwise linker as potential duplicates. The linkage step assigned a score to record pairs using a supervised pairwise-based machine learning model. The clustering step combined record pairs into connected components and further partitioned each connected component to remove inconsistent pairwise links. The result is that input records were partitioned into disjoint sets called profiles, where each profile corresponded to a single person. The material is presented in the form of a comma delimited text file. Each line contains a first name, a nickname or alias, its conditional probability and its frequency. The conditional probability for each nickname is derived from the base data using an algorithim which calculates both the probability for which any alias refers to a given name and a threshold below which the mapping is most likely an error. This threshold eliminates typographic errors and other noise from the data. *Samples* Please view this image sample. Portions © 2012 Intelius, Inc., © 2012 Trustees of the University of Pennsylvania
Extent:		Corpus size: 11264 KB
Identifier:		LDC2012T11
		https://catalog.ldc.upenn.edu/LDC2012T11
		ISBN: 1-58563-619-3
		ISLRN: 756-362-661-905-7
		DOI: 10.35111/kjfh-jw12
Language:		English
Language (ISO639):		eng
License:		American English Nickname Collection: https://catalog.ldc.upenn.edu/license/american-english-nickname-collection-agreement.pdf
Medium:		Distribution: Web Download
Publisher:		Linguistic Data Consortium
Publisher (URI):		https://www.ldc.upenn.edu
Relation (URI):		https://catalog.ldc.upenn.edu/docs/LDC2012T11
Type (DCMI):		Text
Type (OLAC):		primary_text
OLAC Info
Archive:		The LDC Corpus Catalog
Description:		http://www.language-archives.org/archive/www.ldc.upenn.edu
GetRecord:		OAI-PMH request for OLAC format
GetRecord:		Pre-generated XML file
OAI Info
OaiIdentifier:		oai:www.ldc.upenn.edu:LDC2012T11
DateStamp:		2021-12-09
GetRecord:		OAI-PMH request for simple DC format
Search Info
Citation:		Carvalho, Vitor R.; Kiran, Yigit; Borthwick, Andrew. 2012. Linguistic Data Consortium.
Terms:		area_Europe country_GB dcmi_Text iso639_eng olac_primary_text