András Kornai
SZTAKI Institute of Computer Science, Budapest University of Technology and Economics
- Publications
- Influence
The choice of natural language technology appropriate for a given language is greatly impacted by density (availability of digitally stored material). More than half of the world speaks medium… Expand
In the world of non-proprietary NLP software the standard, and perhaps the best, HMM-based POS tagger is TnT (Brants, 2000). We argue here that some of the criticism aimed at HMM performance on… Expand
In this work we study the dynamical features of editorial wars in Wikipedia (WP). Based on our previously established algorithm, we build up samples of controversial and peaceful articles and analyze… Expand
Of the approximately 7,000 languages spoken today, some 2,500 are generally considered endangered. Here we argue that this consensus figure vastly underestimates the danger of digital language death,… Expand
The paper provides an overview of the open source Hungarian language resources that the SzoSzablya ‘WordSword’ project is creating. An extensive crawl of the .hu domain yielded a raw dataset of over… Expand
We present a language-independent optical character recognition system that is capable, in principle, of recognizing printed text from most of the world's languages. For each new language or script… Expand
The commonsensical assumption that any language has only finitely many words is shown to be false by a combination of formal and empirical arguments. Zipf's Law and related formulas are investigated… Expand
Common tasks involving orthographic words include spellchecking, stemming, morphological analysis, and morphological synthesis. To enable significant reuse of the language-specific resources across… Expand
We present a state-of-the-art algorithm for measuring the semantic similarity of word pairs using novel combinations of word embeddings, WordNet, and the concept dictionary 4lang. We evaluate our… Expand
The aim of this paper is to describe the internal syntax of Hungarian noun phrases in terms of their immediate constituent structure. The external syntax of NPs, i.e. their distribution in larger… Expand