Conducting real-time multiplayer experiments on the web

@article{Hawkins2015ConductingRM,
  title={Conducting real-time multiplayer experiments on the web},
  author={Robert D. Hawkins},
  journal={Behavior Research Methods},
  year={2015},
  volume={47},
  pages={966-976}
}
Group behavior experiments require potentially large numbers of participants to interact in real time with perfect information about one another. In this paper, we address the methodological challenge of developing and conducting such experiments on the web, thereby broadening access to online labor markets as well as allowing for participation through mobile devices. In particular, we combine a set of recent web development technologies, including Node.js with the Socket.io module, HTML5… 
View on Springer
rxdhawkins.files.wordpress.com
40 Citations
Highly Influential Citations
2
Background Citations
14
Methods Citations
16

40 Citations

nodeGame: Real-time, synchronous, online experiments in the browser
  • S. Balietti
  • Computer Science
    Behavior research methods
  • 2017
AbstractnodeGame is a free, open-source JavaScript/ HTML5 framework for conducting synchronous experiments online and in the lab directly in the browser window. It is specifically designed to support…
NodeGame : Real-Time Social Experiments in the Browser
NodeGame is a software framework for conducting behavioral experiments online and in the lab directly in the browser window. It allows both real time and discrete time experiments, and with…
How to implement real-time interaction between participants in online surveys: A practical guide to SMARTRIQS
  • A. Molnar
  • Computer Science
    The Quantitative Methods for Psychology
  • 2019
TLDR
This paper provides researchers a practical guide to SMARTRIQS and shows them how to turn regular (non-interactive) online surveys into fully interactive experiments.
OGUMI—A new mobile application to conduct common-pool resource experiments in continuous time
TLDR
The motivation for the development of OGUMI is presented and the main features of the application are discussed, including its capacity to capture real-time changes in human behaviour in response to a dynamically varying resource.
Studying Complex Interactions in Real Time: an XMPP-based Framework for Behavioral Experiments
TLDR
A framework based on Python and XMPP is presented that aims to make it easy to develop real-time, networked experiments with multiple participants, and an illustrative example of how the framework can be used is presented.
The Online Coalition Game: A tool for online interactive coalition formation research
In this paper, we present the Online Coalition Game (OCG): an open-source tool written for the open-access research platform oTree that enables high-powered interactive coalition formation…
The Formation of Social Conventions in Real-Time Environments
TLDR
In agreement with other studies manipulating continuity of interaction, it is found that players who were allowed to interact continuously within rounds achieved outcomes with greater efficiency and fairness thanPlayers who were forced to make simultaneous decisions.
Modeling the formation of social conventions from embodied real-time interactions
TLDR
This work proposes a computational model that matches human behavioral data in a social decision-making game that was analyzed both in discrete-time and continuous-time setups and shows that CRL is able to reach human-level performance on standard game-theoretic metrics such as efficiency in acquiring rewards and fairness in reward distribution.
Web-Based Research in Psychology
TLDR
Pitfalls and best practices are described then, especially regarding dropout and other non-response, recruitment of participants, and interaction between technology and psychological factors.
Planning, Inference and Pragmatics in Sequential Language Games
TLDR
A model is proposed that captures all three characteristics of a successful player in sequential language games and demonstrates their importance in capturing human behavior on a new goal-oriented dataset the authors collected using crowdsourcing.
...
...

References

SHOWING 1-10 OF 32 REFERENCES
Conducting behavioral research on Amazon’s Mechanical Turk
TLDR
It is shown that when taken as a whole Mechanical Turk can be a useful tool for many researchers, and how the behavior of workers compares with that of experts and laboratory subjects is discussed.
Standards for Internet-based experimenting.
TLDR
Advice is presented on ideal circumstances for conducting a study on the Internet, what precautions have to be undertaken in Web experimental design, which techniques have proven useful in Web experimenting, and which frequent errors and misconceptions need be avoided.
Amazon's Mechanical Turk
TLDR
Findings indicate that MTurk can be used to obtain high-quality data inexpensively and rapidly and the data obtained are at least as reliable as those obtained via traditional methods.
Software for continuous game experiments
TLDR
ConG is software for conducting economic experiments in continuous and discrete time to create a variety of strategic environments featuring rich visual feedback in continuous time and over continuous action spaces, as well as in discrete time or over discrete action spaces.
Node : Up and Running : Scalable Server-Side Code with JavaScript
TLDR
For a swiftly evolving framework in its relative infancy, this book serves as an illustrious introduction and start-up guide and anyone thinking of working with Node should definitely have a read of this book.
Running Experiments on Amazon Mechanical Turk
textabstractAlthough Mechanical Turk has recently become popular among social scientists as a source of experimental data, doubts may linger about the quality of data provided by subjects recruited…
Continuous time and communication in a public-goods experiment
Node.js: Using JavaScript to Build High-Performance Network Programs
TLDR
A framework for developing high-performance, concurrent programs that don't rely on the mainstream multithreading approach but use asynchronous I/O with an event-driven programming model.
How Individuals Learn to Take Turns: Emergence of Alternating Cooperation in a Congestion Game and the Prisoner's Dilemma
TLDR
It is found that individuals tend towards a user equilibrium with equal travel times in the beginning, however, after many iterations, they often establish a coherent oscillatory behavior, as taking turns performs better than applying pure or mixed strategies and the resulting behavior is fair and compatible with system-optimal road usage.
Consensus and Cooperation in Networked Multi-Agent Systems
This paper provides a theoretical framework for analysis of consensus algorithms for multi-agent networked systems with an emphasis on the role of directed information flow, robustness to changes in…
...
...