• Publications
  • Influence
Join Size Estimation Subject to Filter Conditions
In this paper, we present a new algorithm for estimating the size of equality join of multiple database tables. The proposed algorithm, Correlated Sampling, constructs a small space synopsis for eachExpand
  • 47
  • 8
A convergent actor-critic-based FRL algorithm with application to power management of wireless transmitters
This paper provides the first convergence proof for fuzzy reinforcement learning (FRL) as well as experimental results supporting our analysis. We extend the work of Konda and Tsitsiklis, whoExpand
  • 59
  • 6
A reinforcement learning framework for online data migration in hierarchical storage systems
  • D. Vengerov
  • Computer Science
  • The Journal of Supercomputing
  • 2007
Abstract Multi-tier storage systems are becoming more and more widespread in the industry. They have more tunable parameters and built-in policies than traditional storage systems, and an adequateExpand
  • 27
  • 4
Advantages of cooperation between reinforcement learning agents in difficult stochastic problems
Presents the first results in understanding the reasons for cooperative advantage between reinforcement learning agents. We consider a cooperation method which consists of using and updating a commonExpand
  • 54
  • 3
Cooperation and coordination between fuzzy reinforcement learning agents in continuous state partially observable Markov decision processes
We consider a pseudo-realistic world in which one or more opportunities appear and disappear in random locations. Agents use fuzzy reinforcement learning to learn which opportunities are most worthyExpand
  • 35
  • 3
Adaptive data-aware utility-based scheduling in resource-constrained systems
This paper addresses the problem of the dynamic scheduling of data-intensive multiprocessor jobs. Each job requires some number of CPUs and some amount of data that needs to be downloaded into aExpand
  • 19
  • 3
A fuzzy reinforcement learning approach to power control in wireless transmitters
We address the issue of power-controlled shared channel access in wireless networks supporting packetized data traffic. We formulate this problem using the dynamic programming framework and present aExpand
  • 47
  • 2
FACT: a framework for adaptive contention-aware thread migrations
Thread scheduling in multi-core systems is a challenging problem because cores on a single chip usually share parts of the memory hierarchy, such as last-level caches, prefetchers and memoryExpand
  • 27
  • 2
Modeling, analysis and throughput optimization of a generational garbage collector
One of the garbage collectors in Sun's HotSpot "Java" Virtual Machine is known as the generational throughput collector, which was designed to have a large throughput (fraction of time spent onExpand
  • 27
  • 2
A reinforcement learning framework for utility-based scheduling in resource-constrained systems
  • D. Vengerov
  • Computer Science
  • Future Gener. Comput. Syst.
  • 1 July 2009
This paper presents a general methodology for online scheduling of parallel jobs onto multi-processor servers in a soft real-time environment, where the final utility of each job decreases with theExpand
  • 32
  • 2