• Corpus ID: 239616041

Reinforcement Learning for Process Control with Application in Semiconductor Manufacturing

  title={Reinforcement Learning for Process Control with Application in Semiconductor Manufacturing},
  author={Yanrong Li and Juan Du and Wei Jiang},
  • Yanrong Li, Juan Du, Wei Jiang
  • Published 22 October 2021
  • Computer Science, Engineering
  • ArXiv
Process control is widely discussed in the manufacturing process, especially for semiconductor manufacturing. Due to unavoidable disturbances in manufacturing, different process controllers are proposed to realize variation reduction. Since reinforcement learning (RL) has shown great advantages in learning actions from interactions with a dynamic system, we introduce RL methods for process control and propose a new controller called RL-based controller. Considering the fact that most existing… 

Figures and Tables from this paper


A survey of run-to-run control for batch processes.
A comprehensive literature review of R2R control methods for the batch process and several case studies concerning a chemical mechanical planarization (CMP), a multi-input and multi-output (MIMO) system of the furnace process control and the management of blood glucose (BG) are presented.
A General Harmonic Rule Controller for Run-to-Run Process Control
The existence of initial bias in parameter estimation is an important issue in controlling short-run processes in semiconductor manufacturing. Harmonic rule has been widely used in machine setup
A batch-based run-torun process control scheme for semiconductor manufacturing
Run-to-Run (R2R) control has been widely used in semiconductor manufacturing to compensate for process disturbance and to improve quality. The traditional R2R controller only takes the process output
A comparative analysis of run-to-run control algorithms in the semiconductor manufacturing industry
  • Zhe Ning, J. Moyne, +4 authors A. Hurwitz
  • Engineering
    IEEE/SEMI 1996 Advanced Semiconductor Manufacturing Conference and Workshop. Theme-Innovative Approaches to Growth in the Semiconductor Industry. ASMC 96 Proceedings
  • 1996
A number of algorithms have been developed that are applicable to the run-to-run control of semiconductor manufacturing processes. The algorithm implementations include the linear approximation
An adaptive run-to-run optimizing controller for linear and nonlinear semiconductor processes
This paper presents a new run-to-run (R2R) multiple-input-multiple-output controller for semiconductor manufacturing processes. The controller, termed optimizing adaptive quality controller (OAQC),
A study of variable EWMA controller
The exponentially weighted moving average (EWMA) feedback controller (with a fixed discount factor) is a popular run by run control scheme which primarily uses data from past process runs to adjust
Control relevant issues in semiconductor manufacturing : Overview with some new results
The quality control of integrated circuit (IC) processing is becoming more and more important as the wafer becomes larger and the feature size shrinks. However, an advanced IC fabrication process
Integrated design of run-to-run PID controller and SPC monitoring for process disturbance rejection
An integrated design methodology has been developed for a run-to-run PID controller and SPC monitoring for the purpose of process disturbance rejection. In the paper, the process disturbance is
Run-to-run control of batch production process in manufacturing systems based on online measurement
The results of simulation experiments and a case study show that the proposed method can effectively improve the control performance for batch production process in manufacturing systems when compared to other run-to-run-based methods.
A Tour of Reinforcement Learning: The View from Continuous Control
  • B. Recht
  • Computer Science, Mathematics
    Annual Review of Control, Robotics, and Autonomous Systems
  • 2019
This article surveys reinforcement learning from the perspective of optimization and control, with a focus on continuous control applications. It reviews the general formulation, terminology, and