Victor Uc Cetina

Learn More
We introduce a supervised reinforcement learning (SRL) architecture for robot control problems with high dimensional state spaces. Based on such architecture two new SRL algorithms are proposed. In our algorithms, a behavior model learned from examples is used to dynamically reduce the set of actions available from each state during the early reinforcement(More)
Using multilayer perceptrons (MLPs) to approximate the state-action value function in reinforcement learning (RL) algorithms could become a nightmare due to the constant possibility of unlearning past experiences. Moreover, since the target values in the training examples are bootstraps values, this is, estimates of other estimates, the chances to get stuck(More)
Chagas disease is a tropical parasitic disease caused by the flagellate protozoan Trypanosoma cruzi (T. cruzi) and currently affecting large portions of the Americas. One of the standard laboratory methods to determine the presence of the parasite is by direct visualization in blood smears stained with some colorant. This method is time-consuming, requires(More)
Quantification of impact craters on planetary surfaces is relevant to understand the geological history of the planet. In order to automatize quantification of lunar craters in digital images, the first step is to develop a computational tool capable of classifying a subwindow of pixels into two possible outputs: crater / non-crater. In this paper, we(More)
In a service oriented architecture based on web services exists the possibility of failures occurring at the time a transaction between web services runs. These failures are undesired because they reduce the system's performance. Self-healing systems are based on the model of the human body to restore it from an unhealthy state to a healthy one. These(More)