Parsing with subdomain instance weighting from raw corpora


The treebanks that are used for training statistical parsers consist of hand-parsed sentences from a single source/domain like newspaper text. However, newspaper text concerns different subdomains of language use (e.g. finance, sports, politics, music), which implies that the statistics gathered by generative statistical parsers are averages over subdomain statistics. In this paper we explore a method, subdomain instance-weighting, that exploits raw subdomain corpora for introducing subdomain statistics into a state-of-the-art generative parser. We employ instance-weighting for creating an ensemble of subdomain specific versions of the parser, and explore methods for amalgamating their predictions. Our experiments show that subdomain statistics extracted from raw corpora can even improve the quality of the n-best lists of a formidable, state-of-the-art parser.

Extracted Key Phrases

Cite this paper

@inproceedings{Plank2008ParsingWS, title={Parsing with subdomain instance weighting from raw corpora}, author={Barbara Plank and Khalil Sima'an}, booktitle={INTERSPEECH}, year={2008} }