Model-based Utility Functions

@inproceedings{Hibbard2012ModelbasedUF,
  title={Model-based Utility Functions},
  author={B. Hibbard},
  booktitle={J. Artif. Gen. Intell.},
  year={2012}
}
  • B. Hibbard
  • Published in J. Artif. Gen. Intell. 2012
  • Computer Science
Abstract Orseau and Ring, as well as Dewey, have recently described problems, including self-delusion, with the behavior of agents using various definitions of utility functions. An agent's utility function is defined in terms of the agent's history of interactions with its environment. This paper argues, via two examples, that the behavior problems can be avoided by formulating the utility function in two steps: 1) inferring a model of the environment from interactions, and 2) computing… Expand
41 Citations
Self-Modeling Agents and Reward Generator Corruption Bill Hibbard
  • PDF
Ethical Artificial Intelligence
  • 15
  • PDF
Categorizing Wireheading in Partially Embedded Agents
  • 4
  • PDF
Utility function security in artificially intelligent agents
  • 38
  • Highly Influenced
  • PDF
Self-Modeling Agents and Reward Generator Corruption
  • B. Hibbard
  • Computer Science
  • AAAI Workshop: AI and Ethics
  • 2015
  • 3
Avoiding Unintended AI Behaviors
  • 22
  • PDF
...
1
2
3
4
5
...

References

SHOWING 1-10 OF 31 REFERENCES
Delusion, Survival, and Intelligent Agents
  • 73
  • PDF
Self-Modification and Mortality in Artificial Agents
  • 51
  • Highly Influential
  • PDF
Learning What to Value
  • 87
  • PDF
Ultimate Cognition à la Gödel
  • 79
  • Highly Influential
  • PDF
Non-axiomatic reasoning system: exploring the essence of intelligence
  • 70
  • PDF
The Basic AI Drives
  • 198
  • PDF
Feature Reinforcement Learning: Part I. Unstructured MDPs
  • Marcus Hutter
  • Computer Science, Mathematics
  • J. Artif. Gen. Intell.
  • 2009
  • 56
  • PDF
Reinforcement Learning: An Introduction
  • 28,055
  • Highly Influential
  • PDF
The Speed Prior: A New Simplicity Measure Yielding Near-Optimal Computable Predictions
  • 66
  • PDF
...
1
2
3
4
...