Corpus ID: 15624049

Hail Mary, Value Porosity, and Utility Diversication

@inproceedings{Bostrom2014HailMV,
  title={Hail Mary, Value Porosity, and Utility Diversication},
  author={Nick Bostrom},
  year={2014}
}
  • Nick Bostrom
  • Published 2014
  • Engineering
  • This paper introduces some new ideas related to the challenge of endowing a hypothetical future superintelligent AI with values that would cause it to act in ways that are benecial. Since candidates for rst-best solutions to this problem (e.g. coherent extrapolated volition) may be very dicult to implement, it is worth also looking for less-ideal solutions that may be more easily implementable, such as the Hail Mary approach. Here I introduce a novel concept|value porosity|for implementing a… CONTINUE READING
    7 Citations
    Backup utility functions as a fail-safe AI technique
    • Caspar Oesterheld
    • 2016
    • 2
    • PDF
    Practical Agents and Fundamental Challenges
    • Highly Influenced
    • PDF
    Avoiding Wireheading with Value Reinforcement Learning
    • 27
    • PDF

    References

    SHOWING 1-10 OF 12 REFERENCES
    Learning What to Value
    • 85
    • PDF
    Infinite Ethics
    • 22
    • PDF
    Logical depth and physical complexity
    • 386
    • PDF
    Omohundro ’ s “ Basic AI Drives ” and Catastrophic Risks
    • 17
    • PDF
    Pascal's mugging
    • 20
    • PDF
    The Speed Prior: A New Simplicity Measure Yielding Near-Optimal Computable Predictions
    • OFI rNw8x'pyzm, GJI pw, +6 authors uRZt ©.£2R
    • 2002
    • 63
    Moral trade. Ethics, forthcoming
    • Moral trade. Ethics, forthcoming
    • 2015
    Utility indifference
    • Utility indifference
    • 2010
    Coherent extrapolated volition
    • Machine Intelligence Research Institute (intelligence.org/files/CEV.pdf )
    • 2004