Deep Reinforcement Learning-Based Network Intrusion Prevention in Cloud-Edge Architectures
Downloads
Cloud-edge architectures enable low-latency distributed data processing but introduce complex attack surfaces that challenge traditional Network Intrusion Detection and Prevention Systems (NIDPS). Conventional systems relying on static signatures and centralized analysis cannot adapt to the dynamic, heterogeneous nature of these environments. This paper proposes a novel Deep Reinforcement Learning (DRL) framework for autonomous network intrusion prevention, deploying intelligent agents at the edge layer capable of real-time network interaction. The agents learn optimal security policies through continuous observation, action, and reward cycles. By analyzing live network traffic, agents classify malicious activities with high accuracy and proactively execute prevention actions including connection blocking and bandwidth throttling. We develop simulated cloud-edge testbed modeling diverse attack scenarios (DDoS, infiltration, data exfiltration) and implement Deep Q-Networks (DQN) and Proximal Policy Optimization (PPO) algorithms. Evaluation using NSL-KDD and CIC-IDS2017 datasets demonstrates significant improvements: 98.7% detection accuracy, 1.8% false positive rate, and sub-20ms response time, providing robust self-adaptive defense for distributed computing infrastructures.
W. Shi, J. Cao, Q. Zhang, Y. Li, and L. Xu, “Edge computing: Vision and challenges,” IEEE Internet of Things Journal, vol. 3, no. 5, pp. 637–646, Oct. 2016.
P. Porambage, J. Okwuibe, M. Liyanage, M. Ylianttila, and T. Taleb, “Survey on multi-access edge computing for IoT realization,” IEEE Communications Surveys & Tutorials, vol. 20, no. 4, pp. 2961–2991, 2018.
Y. Mao, C. You, J. Zhang, K. Huang, and K. B. Letaief, “A survey on mobile edge computing: The communication perspective,” IEEE Communications Surveys & Tutorials, vol. 19, no. 4, pp. 2322–2358, 2017.
S. Yi, Z. Hao, Z. Qin, and Q. Li, “Fog computing: Platform and applications,” in Proc. IEEE HotWeb, 2015, pp. 73–78.
V. Mnih et al., “Human-level control through deep reinforcement learning,” Nature, vol. 518, pp. 529–533, Feb. 2015.
Zeng, Yi, et al. "$ Deep-Full-Range $: a deep learning based network encrypted traffic classification and intrusion detection framework." IEEE Access 7 (2019): 45182-45190.
J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Proximal policy optimization algorithms,” arXiv:1707.06347, 2017.
A. L. Buczak and E. Guven, “A survey of data mining and machine learning methods for cyber security intrusion detection,” IEEE Communications Surveys & Tutorials, vol. 18, no. 2, pp. 1153–1176, 2016.
Alavizadeh, Hooman, Hootan Alavizadeh, and Julian Jang-Jaccard. "Deep Q-learning based reinforcement learning approach for network intrusion detection." Computers 11.3 (2022): 41.
S. Cao, Y. Li, J. Chen, and X. Wang, “A survey on security aspects for 5G networks,” IEEE Communications Surveys & Tutorials, vol. 23, no. 1, pp. 415–460, 2021.
H. H. Pajouh, R. Javidan, R. Khayami, D. Hashemi, and K. R. Choo, “A two-layer dimension reduction and two-tier classification model for anomaly-based intrusion detection in IoT backbone networks,” IEEE Transactions on Emerging Topics in Computing, vol. 7, no. 2, pp. 314–323, Apr. 2019.
I. Sharafaldin, A. Habibi Lashkari, and A. A. Ghorbani, “A detailed analysis of the CIC-IDS2017 dataset,” in Proc. IEEE ICCST, 2018.
I. Sharafaldin, A. H. Lashkari, and A. Ghorbani, “Toward generating a new intrusion detection dataset and intrusion traffic characterization,” in Proc. ICISSP, 2018, pp. 108–116. (CIC-IDS2017)
M. Tavallaee, E. Bagheri, W. Lu, and A. A. Ghorbani, “A detailed analysis of the KDD CUP 99 data set,” in Proc. IEEE CISDA, 2009. (NSL-KDD)
A. Habibi Lashkari, G. Draper Gil, M. Mamun, and A. A. Ghorbani, “Characterization of Tor traffic using time based features,” in Proc. ICISSP, 2017, pp. 253–262. (Discusses flow extraction issues relevant to CICFlowMeter)
Alnaim, Abdulrahman K., and Ahmed M. Alwakeel. "Machine-learning-based IoT–edge computing healthcare solutions." Electronics 12.4 (2023): 1027.
