Creating Crowdsourced Research Talks at Scale

  title={Creating Crowdsourced Research Talks at Scale},
  author={Rajan Vaish and Shirish Goyal and Amin Saberi and Sharad Goel},
  journal={Proceedings of the 2018 World Wide Web Conference},
There has been a marked shift towards learning and consuming information through video. Most academic research, however, is still distributed only in text form, as researchers often have limited time, resources, and incentives to create video versions of their work. To address this gap, we propose, deploy, and evaluate a scalable, end-to-end system for crowdsourcing the creation of short, 5-minute research videos based on academic papers. Doing so requires solving complex coordination and… 

Figures from this paper

A Low-Code Framework for Complex Crowdsourcing Work Based on Process Modeling

This paper provides a task model composition to allow task creation on demand, while collaborating on tasks in a tree structure to adapt to the dynamic execution, and constructs a framework named CrowdModeller to embody this approach.

Towards a typology development of crowdsourcing in science

Crowdsourcing in science as collaborative online process through which non-professional and/or professional scientists incorporate a group of individuals of varying, diversity knowledge and skills,

VidLyz: An Interactive Approach to Assist Novice Entrepreneurs in Making Persuasive Campaign Videos

This paper developed a functional prototype of VidLyz, an assistive web-based tool which consists of the following two modules: an interactive interface module that helps novice entrepreneurs learn the nuances of persuasion factors and enables them to make a comprehensive plan to make effective campaign videos for their target donor audience.

Causeway: Scaling Situated Learning with Micro-Role Hierarchies

This paper introduces micro-role hierarchies, a form of coordination that integrates workflows and hierarchies to help short-term novices predictably contribute to complex projects.


Videos are essential for successful crowdfunding campaigns. However, without knowledge of the underlying persuasion factors, novice entrepreneurs may find it difficult to optimize their videos for

The State-of-the-Art on Collective Intelligence in Online Educational Technologies

A systematic literature review of how collective intelligence has been used in online learning environments and identifying the benefits and/or the difficulties that are encountered in the process of its use has shown that CI enables the exploration.

VisiFit: Structuring Iterative Improvement for Novice Designers

This work presents VisiFit – a computational design system that uses this method to enable novice graphic designers to improve blends with computationally generated options they can select, adjust, and chain together.

r/science: Challenges and Opportunities in Online Science Communication

It is shown that r/science facilitates rich information exchange and that the comments section provides a unique science communication document that guides engagement with scientific research.

Evaluating Creativity Support Tools in HCI Research

A survey of 113 research papers that present and evaluate Creativity Support Tools, and a recommendations for future CST evaluation are offered.

Mapping the Landscape of Creativity Support Tools in HCI

Based on a literature review of 143 papers from the ACM Digital Library (1999-2018), a first overview of the key characteristics of CSTs developed by the HCI community is contributed and a tentative definition of a CST is proposed to help strengthen knowledge sharing across CST studies.



Expert crowdsourcing with flash teams

It is demonstrated that Foundry and flash teams enable crowdsourcing of a broad class of goals including design prototyping, course development, and film animation, in half the work time of traditional self-managed teams.

Crowdsourcing step-by-step information extraction to enhance existing how-to videos

This research introduces a novel crowdsourcing workflow that extracts step-by-step structure from an existing video, including step times, descriptions, and before and after images, and introduces the Find-Verify-Expand design pattern for temporal and visual annotation.

Shepherding the crowd yields better work

This paper investigates whether timely, task-specific feedback helps crowd workers learn, persevere, and produce better results in micro-task platforms by discussing interaction and infrastructure approaches for integrating real-time assessment into online work.

Soylent: a word processor with a crowd inside

S soylent, a word processing interface that enables writers to call on Mechanical Turk workers to shorten, proofread, and otherwise edit parts of their documents on demand, and the Find-Fix-Verify crowd programming pattern, which splits tasks into a series of generation and review stages.

IdeaHound: Improving Large-scale Collaborative Ideation with Crowd-Powered Real-time Semantic Modeling

This paper introduces IdeaHound, an ideation system that seamlessly integrates the task of defining semantic relationships among ideas into the primary task of idea generation, and creates a more accurate semantic model than an existing crowdsourced approach (performed by external crowds).

CrowdCrit: crowdsourcing and aggregating visual design critique

CrowdCrit is a system which leverages paid crowdsourcing to generate and visualize high-quality visual design critique and extends prior crowd feedback research by focusing on scaffolding the process and language of studio critique for crowds.

Ensemble: exploring complementary strengths of leaders and crowds in creative collaboration

This work suggests that asymmetric creative contributions may support a broad new class of creative collaborations, where a leader directs the high-level vision for a story and articulates creative constraints for the crowd.

CrowdTone: Crowd-powered tone feedback and improvement system for emails

CrowdTone utilizes the context and content of an email message to identify and set the appropriate tone through a consensus-building process executed by crowd workers.

QuickCut: An Interactive Tool for Editing Narrated Video

QuickCut is presented, an interactive video editing tool designed to help authors efficiently edit narrated video and applies dynamic programming optimization to choose frame-level cut points between the video segments while maintaining alignments with the narration and adhering to low-level film editing guidelines.