Modeling recursive reasoning by humans using empirically informed interactive POMDPs

Abstract

Recursive reasoning of the form what do I think that you think that I think (and so on) arises often while acting rationally in multiagent settings. Several multiagent decision-making frameworks such as RMM, I-POMDP and the theory of mind model recursive reasoning as integral to an agent’s rational choice. Real-world application settings for multiagent decision making are often mixed involving humans and human-controlled agents. In two large experiments, we studied the level of recursive reasoning generally displayed by humans while playing sequential general-sum and fixedsum, two-player games. Our results show that subjects experiencing a general-sum strategic game display first or second level of recursive thinking with the first level being more prominent. However, if the game is made simpler and more competitive with fixedsum payoffs, subjects predominantly attributed first-level recursive thinking to opponents thereby acting using second level of reasoning. Subsequently, we model the behavioral data obtained from the studies using the I-POMDP framework, appropriately augmented using well-known human judgment and decision models. Accuracy of the predictions by our models suggest that these could be viable ways for computationally modeling strategic behavioral data.

DOI: 10.1145/1838206.1838365

Extracted Key Phrases

10 Figures and Tables

Cite this paper

@inproceedings{Doshi2010ModelingRR, title={Modeling recursive reasoning by humans using empirically informed interactive POMDPs}, author={Prashant Doshi and Xia Qu and Adam Goodie and Diana L. Young}, booktitle={AAMAS}, year={2010} }