• Publications
  • Influence
Reconciling reinforcement learning models with behavioral extinction and renewal: implications for addiction, relapse, and problem gambling.
Because learned associations are quickly renewed following extinction, the extinction process must include processes other than unlearning. However, reinforcement learning models, such as theExpand
  • 282
  • 23
  • PDF
A unified framework for addiction: Vulnerabilities in the decision process
Abstract The understanding of decision-making systems has come together in recent years to form a unified theory of decision-making in the mammalian brain as arising from multiple, interactingExpand
  • 394
  • 18
  • PDF
Hippocampal replay contributes to within session learning in a temporal difference reinforcement learning model
TLDR
We suggest that the replay phenomenon, in which ensembles of hippocampal neurons replay previously experienced firing sequences during subsequent rest and sleep, may provide practice sequences to improve the speed of TDRL learning, even within a single session. Expand
  • 91
  • 7
  • PDF
An Experiment in Using Virtual Worlds for Scientific Visualization of Self-Gravitating Systems
In virtual worlds, objects fall straight down. By replacing a few lines of code to include Newton's gravity, virtual world software can become an N-body simulation code with visualization includedExpand
  • 15
  • 1
  • PDF
Exposure to sexualized media content and selective attention for sexual cues: An experimental study
TLDR
Experiment to test how sexualized media exposure affects the subconscious process of attention allocation to subsequently encountered stimuli. Expand
  • 8
  • PDF
Pattern matching in reconfigurable logic for packet classification
TLDR
We describe a digital circuit synthesis algorithm specialized for the domain of pattern matching circuits implemented in reconfigurable logic. Expand
  • 8
A Versatile Arterial Training Simulator for Intra-arterial Devices
TLDR
We have designed and implemented a versatile simulator that can be used for the training of surgeons to insert intra-arterial devices during operative vascular procedures. Expand
  • 2
Rapid Synthesis of Pattern Classification Circuits
TLDR
We describe SWITCHGEN, a system for circuit synthesis and layout specialized for the domain of pattern matching circuits implemented in reconfigurable logic. Expand
  • 1
Methods and Considerations for Testing Resistive Memories
Nigel West (ed.), MI5 in the Great War