Juan Carlos Santamaría

Learn More
A key element in the solution of reinforcement learning problems is the value function The purpose of this function is to measure the long term utility or value of any given state The function is important because an agent can use this measure to decide what to do next A common problem in reinforcement learning when applied to systems having continuous(More)
Case-based reasoning systems have traditionallybeen used to perform high-level reasoning in problem domains that can be adequately described using discrete, symbolic representations. However, many realworld problem domains, such as autonomous robotic navigation, are better characterized using continuous representations. Such problem domains also require(More)
The goal of transfer learning is to use the knowledge acquired in a set of source tasks to improve performance in a related but previously unseen target task. In this paper, we present a multilayered architecture named CAse-Based Reinforcement Learner (CARL). It uses a novel combination of Case-Based Reasoning (CBR) and Reinforcement Learning (RL) to(More)
Georgia Tech won the O ce Cleanup Event at the 1994 AAAI Mobile Robot Competition with a multi-robot cooperating team. This paper describes the design and implementation of these reactive trash-collecting robots, including details of multiagent cooperation, color vision for the detection of perceptual object classes, temporal sequencing of behaviors for(More)
This paper describes the results from a feasibility analysis performed on two diierent structured light system designs and the image processing algorithms they require for dent detection and localization. The impact of each structured light system is analyzed in terms of their mechanical realization and the complexity of the image processing algorithms(More)
This paper describes lessons learned in the design, construction and programming of a team of three reactive trash-collecting robots. The robots placed first in the Office Cleanup Event at the 1994 AAAI Mobile Robot Competition. The discussion includes details of multiagent cooperation, color vision for the detection of perceptual object classes, temporal(More)
  • 1