• Publications
  • Influence
All That’s ‘Human’ Is Not Gold: Evaluating Human Evaluation of Generated Text
TLDR
The role untrained human evaluations play in NLG evaluation is examined and three approaches for quickly training evaluators to better identify GPT3-authored text are explored and it is found that while evaluation accuracy improved up to 55%, it did not significantly improve across the three domains.
A Case for Design Localization : Diversity of Website Designs in 44 Countries
TLDR
The first large-scale analysis of 80,901 website designs across 44 countries, made available via an interactive web-based design catalog, finds significant differences between several design aspects, such as a website’s colorfulness, visual complexity, the number of text areas and the average saturation of colors.
Generating Scientific Definitions with Controllable Complexity
Unfamiliar terminology and complex language can present barriers to understanding science. Natural language processing stands to help address these issues by automatically defining unfamiliar terms.
Keep it Simple: How Visual Complexity and Preferences Impact Search Efficiency on Websites
TLDR
It is confirmed that the visual complexity of a website has a significant negative effect on search efficiency and information recall, however, the search efficiency of those who preferred simple websites was more negatively affected by highly complex websites than those who prefer high visual complexity.
The Effect of Moderation on Online Mental Health Conversations
TLDR
It is found that participation in group mental health discussions led to improvements in psychological perspective, and that these improvements were larger in moderated conversations, suggesting that moderation can serve as a valuable tool to improve the efficacy and safety of online mental health conversations.
A Case for Design Localization: Diversity of Website Aesthetics in 44 Countries
TLDR
This work contributes the first large-scale analysis of 80,901 website designs across 44 countries, made available via an interactive web-based design catalog, showing that the design of websites with a global reach are more homogenized compared to local websites between countries.
Pay Attention, Please: Formal Language Improves Attention in Volunteer and Paid Online Experiments
TLDR
This work explores how formality influences engagement, measured by attention, dropout, time spent on the study and participant performance, in an online study with 369 participants on Mechanical Turk (paid) and LabintheWild (volunteer).
Writing Strategies for Science Communication: Data and Computational Analysis
TLDR
This work compiles a set of writing strategies drawn from a wide range of prescriptive sources and develops an annotation scheme allowing humans to recognize them, and collects and annotates a subset of this corpus.
Explain like I am a Scientist: The Linguistic Barriers of Entry to r/science
TLDR
It is shown that r/science uses a specialized language that is distinct from other subreddits, and it is suggested that the specialized language used in r/ science has a gatekeeping effect, preventing participation by people whose language does not align with that used inr/science.
Framing Effects
TLDR
It is found that slogan frames impact recruitment significantly; changing the slogan frame from a 'supporting science' frame to a 'comparing oneself to others' frame lead to a 9% increase in recruitment for some studies.
...
1
2
...