Salience Bias in Crowdsourcing Contests

@article{Lee2018SalienceBI,
  title={Salience Bias in Crowdsourcing Contests},
  author={Ho Cheung Brian Lee and Sulin Ba and Xinxin Li and Jan Stallaert},
  journal={ERPN: Start-Up \& Small Business Finance (Sub-Topic)},
  year={2018}
}
Crowdsourcing relies on online platforms to connect a community of users to perform specific tasks. However, without appropriate control, the behavior of the online community might not align with the platform’s designed objective, which can lead to an inferior platform performance. This paper investigates how the feedback information on a crowdsourcing platform and systematic bias of crowdsourcing workers can affect crowdsourcing outcomes. Specifically, using archival data from the online… 

Figures and Tables from this paper

Social mechanisms in crowdsourcing contests: a literature review

ABSTRACT Crowdsourcing contests allow organisations to engage with an external workforce. Over the years, the phenomenon has attracted considerable research interest. In the present review, we

Team Formation and Performance in Online Crowdsourcing Competitions: The Role of Homophily and Diversity in Solver Characteristics

Rapid advances in Information Technology (IT) have enabled organizations to venture beyond their workforce to seek solutions to vital business problems through online crowdsourcing platforms. Such

Co-destruction Patterns in Crowdsourcing

TLDR
A collection of so-called co-destruction patterns is provided for an-depth analysis of corwdsourcing systems which can benefit a comparative analysis and also assist with improvements of existing systems or the set-up of new ones.

Community interactions at crowd scale: hybrid crowds on the GitHub platform

TLDR
This exploratory study examines hybrid crowds, which exhibit norms of reciprocity common in communities, as well as patterns of contribution dispersion common in crowds, and shows empirical variation along these two dimensions using data from six machine learning projects hosted on the GitHub software platform.

Confirmation Bias in Adoption of Seeker Exemplars in Crowdsourcing Ideation Contests

This study examines how solution exemplars that seekers provide in crowdsourcing ideation contests affect the scanning, shortlisting, and selection of ideas by solvers; these three ideation

Designing for Information Quality in the Era of Repurposable Crowdsourced User-Generated Content

TLDR
It is argued that crowdsourcing systems that seek participation mainly from contributors who are experienced or have high levels of proficiency in the crowdsourcing task will gather less diverse and therefore less repurposable data.

Never Too Late? The Role of Visiting Delay in Crowdsourcing Contests

TLDR
It is demonstrated that when solvers have higher levels of visiting delay, the deadline effect dominates the time-disadvantage effect, resulting in a faster submission time initially, however, after the first submission, the time’s disadvantage affects the solvers’ likelihood of developing an acceptable submission and a winning submission.

Crowdsourcing as a Strategic IS Sourcing Phenomenon: Critical Review and Insights for Future Research

TLDR
This paper thoroughly reviews the literature to identify both areas of saturation and gaps, with a focus on the strategic organizational context, and offers a road map for future research that brings together fine-grained insights from existing crowdsourcing studies towards developing a high-level, macro-perspective of the crowdsourcing phenomenon and its strategic impact.

Winning by Learning? Effect of Knowledge Sharing in Crowdsourcing Contests

Crowdsourcing is a new way for online crowds to get involved in a company’s research and development process. Businesses can host public contests on online platforms (such as Kaggle, Topcoder, and

References

SHOWING 1-10 OF 54 REFERENCES

Task Division for Team Success in Crowdsourcing Contests: Resource Allocation and Alignment Effects

TLDR
It is found that the alignment of a member’s social and intellectual capital within a team has a significant influence on team performance, and when the competitive intensity is low, this alignment positively affects team performance.

Crowdsourcing with All-Pay Auctions: A Field Experiment on Taskcn

TLDR
It is found that a higher reward induces significantly more submissions and submissions of higher quality, and that high-quality users are significantly less likely to enter tasks where a high- quality solution has already been submitted, resulting in lower overall quality in subsequent submissions in such soft reserve treatments.

Crowdsourcing New Product Ideas Under Consumer Learning

TLDR
A dynamic structural model that illuminates the economic mechanisms shaping individual behavior and outcomes on crowdsourced ideation platforms is proposed and it is shown that providing more precise cost signals to individuals can accelerate the filtering process.

Using the crowd as an innovation partner.

TLDR
After a decade of study, the authors identify when crowds tend to outperform internal organizations (or not) and outline four ways to tap into crowd-powered problem solving--contests, collaborative communities, complementors, and labor markets--and offer a system for picking the best one in a given situation.

Crowdsourcing New Product Ideas over Time: An Analysis of the Dell IdeaStorm Community

TLDR
Studying Dell's IdeaStorm community, serial ideators are found to be more likely than consumers with only one idea to generate an idea the organization finds valuable enough to implement, but they are unlikely to repeat their early success once their ideas are implemented.

Heterogeneous Submission Behavior and its Implications for Success in Innovation Contests with Public Submissions

Innovation contests are increasingly adopting a format where submissions are viewable by all contestants and the information structure changes during the contest. In such an “unblind” format,

Home Bias in Online Investments: An Empirical Study of an Online Crowdfunding Market

TLDR
Home bias appears to be a robust phenomenon under all three scenarios, which has important implications not just for the home bias literature, but also more broadly for the growing research and policy interest on Internet-based crowd funding, especially as a new channel for entrepreneurial financing.

The Impact and Evolution of Group Diversity in Online Open Collaboration

TLDR
The results show a curvilinear effect of tenure disparity, which increases productivity and decreases member withdrawal, up to a point, and beyond that point, productivity slightly decreases, and members are more likely to withdraw.

Incentives and Problem Uncertainty in Innovation Contests: An Empirical Analysis

TLDR
It is shown that the effort-reducing effect of greater rivalry dominates for less uncertain problems, whereas the effect on the extreme value prevails for more uncertain problems and higher uncertainty reduces the negative effect of added competitors on incentives.

Overcoming Salience Bias: How Real-Time Feedback Fosters Resource Conservation

TLDR
In a large-scale field experiment, real-time feedback on the resource consumption of a daily, energy-intensive behavior (showering) is given and it is found that real- time feedback reduced re- source consumption for the target behavior by 22%.
...