Hierarchical decision making in semiconductor fabs using multi-time scale Markov decision processes

@article{Panigrahi2004HierarchicalDM,
  title={Hierarchical decision making in semiconductor fabs using multi-time scale Markov decision processes},
  author={J. Ranjan Panigrahi and Sonali Bhatnagar},
  journal={2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601)},
  year={2004},
  volume={4},
  pages={4387-4392 Vol.4}
}
There are different timescales of decision making in semiconductor fabs. While decisions on buying/discarding of machines are made on the slower timescale, those that deal with capacity allocation and switchover are made on the faster timescale. We formulate this problem along the lines of a recently developed multi-time scale Markov decision process (MMDP) framework and present numerical experiments wherein we use TD(0) and Q-learning algorithms with linear approximation architecture, and show… CONTINUE READING