i-manager Publications

Use of Reinforcement Learning Algorithms to Optimize Control Strategies for Single Machine Systems

R. Merina Queentin*

Department of Electrical and Electronics Engineering, CSI Institute of Technology, Thovalai, Tamil Nadu, India.

Periodicity:July - December'2022
DOI : https://doi.org/10.26634/jic.10.2.19357

Abstract

The stability of power systems is critical to ensuring reliable and efficient operation of electrical grids. In recent years, there has been a growing interest in the use of artificial intelligence techniques, such as reinforcement learning, to improve the stability of single machine systems. Reinforcement learning is a machine learning approach that enables agents to learn optimal control policies through trial and error. In this paper, we explore the use of reinforcement learning algorithms to optimize control strategies for single machine systems. We demonstrate how these algorithms can be used to identify the best control actions to take in real-time to prevent system instability. The challenges and limitations of using reinforcement learning in power system applications are discussed and recommendations are provided for future research in this area. Our results show that reinforcement learning has great potential for improving the stability of single machine systems and can be a valuable tool for power system operators and engineers.

Keywords

Reinforcement Learning, Control Strategies, Single Machine Systems, System Stability, Optimization, Real-Time Control, Artificial Intelligence.

How to Cite this Article?

Queentin, R. M. (2022). Use of Reinforcement Learning Algorithms to Optimize Control Strategies for Single Machine Systems. i-manager’s Journal on Instrumentation & Control Engineering, 10(2), 36-45. https://doi.org/10.26634/jic.10.2.19357

References

[1]. Berkenkamp, F., Turchetta, M., Schoellig, A., & Krause, A. (2017). Safe model-based reinforcement learning with stability guarantees. Advances in Neural Information Processing Systems, 30, 1-11.

[2]. Guo, J., Zenelis, I., Wang, X., & Ooi, B. T. (2020). WAMSbased model-free wide-area damping control by voltage source converters. IEEE Transactions on Power Systems, 36(2), 1317-1327.

[3]. Harrold, D. J., Cao, J., & Fan, Z. (2022). Renewable energy integration and microgrid energy trading using multi-agent deep reinforcement learning. Applied Energy, 318, 119151.

[4]. Jawahir, I. S., Balaji, A. K., Rouch, K. E., & Baker, J. R. (2003). Towards integration of hybrid models for optimized machining performance in intelligent manufacturing systems. Journal of Materials Processing Technology, 139(1-3), 488-498.

[5]. Kuhnle, A., Kaiser, J. P., Theiß, F., Stricker, N., & Lanza, G. (2021). Designing an adaptive production control system using reinforcement learning. Journal of Intelligent Manufacturing, 32, 855-876.

[6]. Li, T., Wang, Z., Lu, W., Zhang, Q., & Li, D. (2022). Electronic health records based reinforcement learning for treatment optimizing. Information Systems, 104, 101878.

[7]. Liu, Q., Dong, M., & Chen, F. F. (2018). Singlemachine- based joint optimization of predictive maintenance planning and production scheduling. Robotics and Computer-Integrated Manufacturing, 51, 238-247.

[8]. Pamsari, H. K., Bidgoli, M. A., Rajabzadeh, M., Bathaee, S. M. T., & Ozgoli, S. (2011, February). Application of a new multivariable sliding mode controller for the single machine infinite bus systems. In 2011 2nd Power Electronics, Drive Systems and Technologies Conference (pp. 211-216). IEEE.

[9]. Wei, C., Zhang, Z., Qiao, W., & Qu, L. (2015). Reinforcement-learning-based intelligent maximum power point tracking control for wind energy conversion systems. IEEE Transactions on Industrial Electronics, 62(10), 6360-6370.

[10]. Xiong, R., Cao, J., & Yu, Q. (2018). Reinforcement learning-based real-time power management for hybrid energy storage system in the plug-in hybrid electric vehicle. Applied Energy, 211, 538-548.

[11]. Younesi, A., Shayeghi, H., & Moradzadeh, M. (2018). Application of reinforcement learning for generating optimal control signal to the IPFC for damping of lowfrequency oscillations. International Transactions on Electrical Energy Systems, 28(2), e2488.

[12]. Zhang, B., Hu, W., Ghias, A. M., Xu, X., & Chen, Z. (2022). Multi-agent deep reinforcement learning-based coordination control for grid-aware multi-buildings. Applied Energy, 328, 120215.

[13]. Zhao, L., Yang, T., Li, W., & Zomaya, A. Y. (2022). Deep reinforcement learning-based joint load scheduling for household multi-energy system. Applied Energy, 324, 119346.