Crowd Coach

@article{Chiang2018CrowdC,
  title={Crowd Coach},
  author={Chun-Wei Chiang and Anna Kasunic and Saiph Savage},
  journal={Proceedings of the ACM on Human-Computer Interaction},
  year={2018},
  volume={2},
  pages={1 - 17}
}
Traditional employment usually provides mechanisms for workers to improve their skills to access better opportunities. [...] Key Method To further facilitate crowd workers' skill growth, we present Crowd Coach, a system that enables workers to receive peer coaching while on the job. We conduct a field experiment and real world deployment to study Crowd Coach in the wild. Hundreds of workers used Crowd Coach in a variety of tasks, including writing, doing surveys, and labeling images. We find that Crowd Coach…Expand
Turker Tales: Integrating Tangential Play into Crowd Work
TLDR
Turker Tales, a Google Chrome extension that uses tangential play to encourage crowd workers to write, share, and view short tales as a side activity to their main job on Amazon Mechanical Turk, is presented. Expand
Predicting the Working Time of Microtasks Based on Workers' Perception of Prediction Errors
TLDR
A computational technique for predicting microtask working times based on past experiences of workers regarding similar tasks and challenges encountered in defining evaluation and/or objective functions have been described based on the tolerance demonstrated by workers with regard to prediction errors. Expand
Predicting the Working Time of Microtasks Based on Workers' Perception of Prediction Errors
TLDR
A computational technique for predicting microtask working times based on past experiences of workers regarding similar tasks and challenges encountered in defining evaluation and/or objective functions have been described based on the tolerance demonstrated by workers with regard to prediction errors. Expand
Becoming the Super Turker:Increasing Wages via a Strategy from High Earning Workers
TLDR
This paper explores how novice workers can improve their earnings by following the transparency criteria of Super Turkers, i.e., crowd workers who earn higher salaries on Amazon Mechanical Turk (MTurk), and highlights that tool development to support crowd workers should be paired with educational opportunities that teach workers how to effectively use the tools. Expand
Becoming the Super Turker: Increasing Wages via a Strategy from High Earning Workers
TLDR
This paper explores how novice workers can improve their earnings by following the transparency criteria of Super Turkers, i.e., crowd workers who earn higher salaries on Amazon Mechanical Turk (MTurk), and finds that novices who utilized this Super Turker criteria earned better wages than other novice. Expand
"I Hope This Is Helpful"
TLDR
Findings from a thematic analysis of 1,064 comments left by Amazon Mechanical Turk workers using this task design to create captions for images taken by people who are blind are discussed. Expand
Making AI Machines Work for Humans in FoW
TLDR
Bringing humans back to the frontier of FoW will increase their trust in AI systems and shift their perception to use them as a source of self-improvement, ensure better work performance, and positively shape social and economic outcomes of a society and a nation. Expand
The Tools of Management
TLDR
The historical development of workplace technology design methods in CSCW is analyzed to show how mid-20th century labor responses to scientific management can inform directions in contemporary digital labor advocacy. Expand
A Microtask Approach to Identifying Incomprehension for Facilitating Peer Learning
TLDR
The result of the preliminary experiment suggests that the approach is effective for identifying students’ incomprehension and it is shown that the identified incomprehensible parts allow people to teach each other. Expand
Navigating Uncertainty in the Future of Work: Information-Seeking and Critical Events Among Online Freelancers
TLDR
This work conducts semi-structured interviews with 29 online freelancers to investigate critical events that contribute to uncertainty early in their online careers, and situate these critical events within the context of organizational assimilation, and how participants employ diverse information-seeking tactics. Expand
...
1
2
...

References

SHOWING 1-10 OF 94 REFERENCES
Scopist: Building a Skill Ladder into Crowd Transcription
TLDR
Scopist is created, a JavaScript application for learning an efficient text-entry method known as stenotype while doing audio transcription tasks, and demonstrates a new way for workers on crowd platforms to align their work and skill development with the accessibility domain while they work. Expand
Toward a Learning Science for Complex Crowdsourcing Tasks
TLDR
This work explores how crowdworkers can be trained to tackle complex crowdsourcing tasks and shows that having workers validate the work of their peer workers can be even more effective than having them review expert examples if the authors only present solutions filtered by a threshold length. Expand
Combining crowdsourcing and learning to improve engagement and performance
TLDR
A platform that combines learning and crowdsourcing to benefit both the workers and the requesters is described, which found that by using the system workers gained new skills and produced high-quality edits for requested images, even if they had little prior experience editing images. Expand
Collaboratively crowdsourcing workflows with turkomatic
TLDR
It is argued that Turkomatic's collaborative approach can be more successful than the conventional workflow design process and implications for the design of collaborative crowd planning systems are discussed. Expand
Is Crowdsourcing a Source of Worker Empowerment or Exploitation? Understanding Crowd Workers' Perceptions of Crowdsourcing Career
TLDR
Assessing the degree to which these platforms afford or constrain the workers to exert their personal agencies will partially determine whether these new forms of work are a harbinger of worker empowerment or exploitation. Expand
Reviewing versus doing: learning and performance in crowd assessment
TLDR
If and how workers learn and improve their performance in a task domain by serving as peer reviewers is explored, and whether peer reviewing may be more effective in teams where the reviewers can reach consensus through discussion is investigated. Expand
A Data-Driven Analysis of Workers' Earnings on Amazon Mechanical Turk
TLDR
The characteristics of tasks and working patterns that yield higher hourly wages are explored, and platform design and worker tools are informed to create a more positive future for crowd work. Expand
Paid Crowdsourcing as a Vehicle for Global Development
By connecting remote workers to a global marketplace, paid crowdsourcing has the potential to improve earnings and livelihoods in poor communities around the world. However, there is a long way to goExpand
Atelier: Repurposing Expert Crowdsourcing Tasks as Micro-internships
TLDR
Atelier, a micro-internship platform that connects crowd interns with crowd mentors, guides mentor-intern pairs to break down expert crowdsourcing tasks into milestones, review intermediate output, and problem-solve together, finding that Atelier helped interns maintain forward progress and absorb best practices. Expand
The future of crowd work
TLDR
This paper outlines a framework that will enable crowd work that is complex, collaborative, and sustainable, and lays out research challenges in twelve major areas: workflow, task assignment, hierarchy, real-time response, synchronous collaboration, quality control, crowds guiding AIs, AIs guiding crowds, platforms, job design, reputation, and motivation. Expand
...
1
2
3
4
5
...