Ryan Cotterell

Suggest Changes
Yoshua Bengio34
Jason Eisner32
Hinrich Schütze30
Chris Dyer29
Manaal Faruqui26
20Hinrich Schütze
15Jason Eisner
14Nikola Mrksic
14Steve J. Young
14Diarmuid Ó Séaghdha

Filter Results:

  • Full text PDF available (31)

Publication Year

2012
2017
  • This year (10)
  • Last five years (31)

Publication Type

Co-author

Publication Venue

Data Set Used

Key Phrases

Learn More
The SIGMORPHON 2016 Shared Task—Morphological Reinflection
The 2016 SIGMORPHON Shared Task was devoted to the problem of morphological reinflection. It introduced morphological datasets for 10 languages with diverse ty-pological characteristics. The shared task drew submissions from 9 teams representing 11 institutions reflecting a variety of approaches to addressing supervised learning of reinflection. For the… (More)
Joint Lemmatization and Morphological Tagging with Lemming
We present LEMMING, a modular log-linear model that jointly models lemmati-zation and tagging and supports the integration of arbitrary global features. It is trainable on corpora annotated with gold standard tags and lemmata and does not rely on morphological dictionaries or an-alyzers. LEMMING sets the new state of the art in token-based statistical… (More)
Labeled Morphological Segmentation with Semi-Markov Models
We present labeled morphological segmentation—an alternative view of morphological processing that unifies several tasks. We introduce a new hierarchy of morphotactic tagsets and CHIPMUNK, a discriminative morphological segmen-tation system that, contrary to previous work, explicitly models morphotactics. We show improved performance on three tasks for all… (More)
Stochastic Contextual Edit Distance and Probabilistic FSTs
a bc z _ a b x _ a ba x _ ε : z / ε : ε / ε : y / ε:x / i n s e r t z insert x s u b s t i t u t e y f o r b d e l e t e b b c x _ rea d c c :ε / 1 a ba x _ a bc x _ To demonstrate the utility of contextual edit transducers, we examine spelling errors in social media data. We report on test data how much probability mass lands on the true. We also report… (More)
Weighting Finite-State Transductions With Neural Context
How should one apply deep learning to tasks such as morphological reinflection, which stochastically edit one string to get another? A recent approach to such sequence-to-sequence tasks is to compress the input string into a vector that is then used to generate the output string, using recurrent neural networks. In contrast, we propose to keep the… (More)
Morphological Smoothing and Extrapolation of Word Embeddings
Languages with rich inflectional morphology exhibit lexical data sparsity, since the word used to express a given concept will vary with the syntactic context. For instance , each count noun in Czech has 12 forms (where English uses only singular and plural). Even in large corpora, we are unlikely to observe all inflections of a given lemma. This reduces… (More)
An Algerian Arabic-French Code-Switched Corpus
Arabic is not just one language, but rather a collection of dialects in addition to Modern Standard Arabic (MSA). While MSA is used in formal situations, dialects are the language of every day life. Until recently, there was very little dialectal Arabic in written form. With the advent of social-media, however, the landscape has changed. We provide the… (More)
Explaining and Generalizing Skip-Gram through Exponential Family Principal Component Analysis
The popular skip-gram model induces word embeddings by exploiting the signal from word-context coocurrence. We offer a new interpretation of skip-gram based on exponential family PCA—a form of matrix factorization. This makes it clear that we can extend the skip-gram method to tensor factorization, in order to train embeddings through richer higher-order… (More)
A Multi-Dialect, Multi-Genre Corpus of Informal Written Arabic
This paper presents a multi-dialect, multi-genre, human annotated corpus of dialectal Arabic with data obtained from both online newspaper commentary and Twitter. Most Arabic corpora are small and focus on Modern Standard Arabic (MSA). There has been recent interest, however, in the construction of dialectal Arabic corpora (Zaidan and Callison-Burch, 2011a;… (More)
Morphological Word-Embeddings
Linguistic similarity is multi-faceted. For instance , two words may be similar with respect to semantics, syntax, or morphology inter alia. Continuous word-embeddings have been shown to capture most of these shades of similarity to some degree. This work considers guiding word-embeddings with morphologically annotated data, a form of semi-supervised… (More)