Author pages are created from data sourced from our academic publisher partnerships and public sources.
BERT Rediscovers the Classical NLP Pipeline
Pre-trained text encoders have rapidly advanced the state of the art on many NLP tasks. We focus on one such model, BERT, and aim to quantify where linguistic information is captured within the… Expand
What do you learn from context? Probing for sentence structure in contextualized word representations
Contextualized representation models such as ELMo (Peters et al., 2018a) and BERT (Devlin et al., 2018) have recently achieved state-of-the-art results on a diverse array of downstream NLP tasks.… Expand
Can You Tell Me How to Get Past Sesame Street? Sentence-Level Pretraining Beyond Language Modeling
Natural language understanding has recently seen a surge of progress with the use of sentence encoders like ELMo (Peters et al., 2018a) and BERT (Devlin et al., 2019) which are pretrained on variants… Expand
WikiAtomicEdits: A Multilingual Corpus of Wikipedia Edits for Modeling Language and Discourse
We release a corpus of 43 million atomic edits across 8 languages. These edits are mined from Wikipedia edit history and consist of instances in which a human editor has inserted a single contiguous… Expand
Ultrafast X-ray Auger probing of photoexcited molecular dynamics.
Molecules can efficiently and selectively convert light energy into other degrees of freedom. Disentangling the underlying ultrafast motion of electrons and nuclei of the photoexcited molecule… Expand
Ultrafast isomerization initiated by X-ray core ionization.
- C. Liekhus-Schmaltz, Ian Tenney, +36 authors V. Petrović
- Medicine, Physics
- Nature communications
- 10 September 2015
Rapid proton migration is a key process in hydrocarbon photochemistry. Charge migration and subsequent proton motion can mitigate radiation damage when heavier atoms absorb X-rays. If rapid enough,… Expand
Probing What Different NLP Tasks Teach Machines about Function Word Comprehension
We introduce a set of nine challenge tasks that test for the understanding of function words. These tasks are created by structurally mutating sentences from existing datasets to target the… Expand
Looking for ELMo's friends: Sentence-Level Pretraining Beyond Language Modeling
Work on the problem of contextualized word representation---the development of reusable neural network components for sentence understanding---has recently seen a surge of progress centered on the… Expand
Semicrystalline Dihydroxyacetone Copolymers Derived from Glycerol
The ring-opening polymerization of glycerol-derived six-membered cyclic dimethylacetal dihydroxyacetone carbonate (MeO2DHAC) have been studied both in solution and bulk conditions with organic… Expand