• Corpus ID: 25007589

Goal Conflict in Designing an Autonomous Artificial System

  title={Goal Conflict in Designing an Autonomous Artificial System},
  author={Mark Muraven},
Research on human self-regulation has shown that people hold many goals simultaneously and have complex self-regulation mechanisms to deal with this goal conflict. Artificial autonomous systems may also need to find ways to cope with conflicting goals. Indeed, the intricate interplay among different goals may be critical to the design as well as long-term safety and stability of artificial autonomous systems. I discuss some of the critical features of the human self-regulation system and how it… 

Tables from this paper


The Dynamics of Goal Revision: A Cybernetic Multiperiod Test-Operate-Test-Adjust-Loop (Total) Model of Self-Regulation
This research presents a comprehensive conceptual model of the dynamics of goal revision over multiple periods. First, based on an integrative literature review, we derive four principles that govern
Mechanisms of Self-Control Failure: Motivation and Limited Resources
It is suggested that depletion only affects performance on tasks that require self-control; tasks that are difficult but do not requireSelf-control are immune to the effects of depletion; depleted individuals may compensate for their lack of self- control resources when sufficiently motivated.
Executive functions and self-regulation
Construal levels and self-control.
High-level construals led to decreased preferences for immediate over delayed outcomes, greater physical endurance, stronger intentions to exert self- control, and less positive evaluations of temptations that undermine self-control.
Self-control in action: implicit dispositions toward goals and away from temptations.
Five studies examined whether, in self-control dilemmas, individuals develop an implicit disposition to approach goals and avoid temptations, psychologically as well as physically, and how strongly individuals were attracted to temptations and held the longer term goal.
Motivational and emotional controls of cognition.
  • H. Simon
  • Psychology, Biology
    Psychological review
  • 1967
The central nervous System is a serial information processor that must serve an organism endowed with multiple needs, and living in an environment that presents unpredictable threats and
Goal hierarchies and plan revision
This paper examined the effects of goal failure on plan revision. We argued that plans can be conceptualized as hierarchies of interrelated goals, such that broad superordinate goals are
Multi-agent Reinforcement Learning in Sequential Social Dilemmas
This work analyzes the dynamics of policies learned by multiple self-interested independent learning agents, each using its own deep Q-network on two Markov games and characterize how learned behavior in each domain changes as a function of environmental factors including resource abundance.
The "What" and "Why" of Goal Pursuits: Human Needs and the Self-Determination of Behavior
Self-determination theory (SDT) maintains that an understanding of human motivation requires a consideration of innate psychological needs for competence, autonomy, and relatedness. We discuss the