Deep Reinforcement Learning Integrated Queuing Architectures For Adaptive Task Orchestration In Cloud Computing Environments
Keywords:
Cloud task scheduling, deep reinforcement learning, queuing theoryAbstract
The accelerating expansion of cloud computing infrastructures has transformed the contemporary digital economy by enabling scalable, elastic, and distributed access to computational resources across heterogeneous environments. As enterprise, scientific, and consumer workloads continue to grow in complexity and volume, the demand for intelligent task scheduling frameworks that can dynamically balance performance, efficiency, and reliability has become increasingly critical. Classical queuing theory has historically provided the foundational analytical backbone for understanding service systems, particularly within computing and telecommunication domains, yet the static and assumption-bound nature of many traditional queuing models has struggled to accommodate the stochastic volatility and multi-objective constraints inherent in modern cloud ecosystems (Kleinrock, 1975; Gross et al., 2008). Simultaneously, reinforcement learning has emerged as a powerful paradigm for decision-making under uncertainty, offering the capacity to adaptively learn optimal control strategies from environmental feedback rather than relying on predetermined rules. The convergence of these two intellectual traditions has opened a promising research frontier, in which learning-driven schedulers are informed and constrained by queuing-theoretic principles.
References
Guo, L., Yan, T., Zhao, S., Jiang, C., et al. (2014). Dynamic performance optimization for cloud computing using M/M/m queueing system. Journal of Applied Mathematics, 2014.
Vilaplana, J., Solsona, F., Teixido, I., Mateo, J., Abella, F., and Rius, J. (2014). A queuing theory model for cloud computing. The Journal of Supercomputing, 69, 492–507.
Kleinrock, L. (1975). Queueing Systems Volume 1: Theory. Wiley-Interscience.
Ali-Eldin, A., Tordsson, J., and Elmroth, E. (2012). An adaptive hybrid elasticity controller for cloud infrastructures. In IEEE Network Operations and Management Symposium, 204–212.
Chang, X., Wang, B., Muppala, J. K., and Liu, J. (2014). Modeling active virtual machines on IaaS clouds using an M/G/m/m plus k queue. IEEE Transactions on Services Computing, 9, 408–420.
Kanikanti, V. S. N., Tiwari, S. K., Nayan, V., Suryawanshi, S., and Chauhan, R. (2025). Deep Q-Learning Driven Dynamic Optimal Task Scheduling for Cloud Computing Using Optimal Queuing. In International Conference on Computational Intelligence and Knowledge Economy, 217–222. IEEE.
Bai, W. H., Xi, J. Q., Zhu, J. X., Huang, S. W., et al. (2015). Performance analysis of heterogeneous data centers in cloud computing using a complex queuing model. Mathematical Problems in Engineering, 2015.
Cheng, C., Li, J., and Wang, Y. (2015). An energy-saving task scheduling strategy based on vacation queuing theory in cloud computing. Tsinghua Science and Technology, 20, 28–39.
AWS Documentation. (n.d.). Introduction to Cloud Computing. AWS Official Documentation.
Xia, Y., Zhou, M., Luo, X., Pang, S., and Zhu, Q. (2015). Stochastic modeling and performance analysis of migration-enabled and error-prone clouds. IEEE Transactions on Industrial Informatics, 11, 495–504.
Harchol-Balter, M. (2013). Performance Modeling and Design of Computer Systems: Queueing Theory in Action. Cambridge University Press.
Gross, D., Shortle, J. F., Thompson, J. M., and Harris, C. M. (2008). Fundamentals of Queueing Theory. Wiley.
Liu, L., Chang, Z., Guo, X., Mao, S., and Ristaniemi, T. (2017). Multiobjective optimization for computation offloading in fog computing. IEEE Internet of Things Journal, 5, 283–294.
Khazaei, H., Misic, J., and Misic, V. B. (2011). Performance analysis of cloud computing centers using M/G/m/m plus r queuing systems. IEEE Transactions on Parallel and Distributed Systems, 23, 936–943.
Tanenbaum, A. S., and Van Steen, M. (2007). Distributed Systems: Principles and Paradigms. Pearson.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Leonard H. Fischer

This work is licensed under a Creative Commons Attribution 4.0 International License.