Ensuring Reliable 5G Networks with DRL

In a paper published in the journal Scientific Reports, researchers addressed the reliability mapping of 5G low orbit constellation network slices to ensure stable link network communication. They tackled state space explosion using deep reinforcement learning (DRL), considering both resource requirements and constraints of virtual network functions (VNF).

Study: Ensuring Reliable 5G Networks with DRL. Image Credit: jamesteohart/Shutterstock
Study: Ensuring Reliable 5G Networks with DRL. Image Credit: jamesteohart/Shutterstock

Node and link backup strategies were implemented to achieve VNF/link reliability. Experiments showed that this approach improved network throughput, reduced packet loss, and repaired network faults within 0.3 seconds. The method maintained high reliability and kept network delay low.

Background

Past work on 5G low orbit constellation network slices includes methods to optimize network performance but faces scalability and computational complexity challenges. Network slicing, which divides a physical network into virtual ones, is crucial for 5G low-orbit constellation networks, ensuring service reliability through backup and recovery mechanisms.

The dynamic nature of these networks presents challenges and opportunities, with DRL algorithms enhancing resource allocation and routing strategies. A delay-driven slicing method, relying on real-time network data, highlights the need for accurate status information. By learning from data and interactions, DRL improves network slicing reliability, automates network management, and reduces manual intervention.

5G Network Reliability

The integrated network architecture of the 5 G low-orbit constellation combines terminal equipment, satellite network functions, satellite baseband gateway (S-GW), mobility management entity (MME), core network resources, and a management system using software-defined networking (SDN) and network function virtualization (NFV) technologies. It separates the core network into processing and forwarding clouds, providing flexibility and programmability. The MME handles signaling, business control, and user mobility management, while the S-GW manages request routing, security control, and protocol conversion to ensure network reliability and security.

In the European Telecommunications Standards Institute Industry Specification Group on NFV (ETSI ISG NFV) terminology, network slices consist of VNFs and physical NF (PNFs) linked to form a service function chain (SFC). Service choreographers generate service function chains (SFCs) based on service requests, utilizing mapping algorithms for network slice instantiation. These slices create isolated virtual networks on satellite infrastructure. RL faces challenges like data collection, real-time demands, balancing network performance, and ensuring security and stability.

Service orchestration in network architecture manages and optimizes slicing resources, typically deployed in central control nodes like network management system (NMS), network function virtualization orchestrator (NFVO), or network slice manager (NSM). NMS provides a global view and manages network slice resources, while NFVO handles the life cycle of network services. NSM directly controls and manages slicing resources. The deployment location affects transmission delay, with NMS offering low delay for core network slices, NFVO for virtualized functions, and NSM for rapid slice resource management.

The physical network supports 5G low-orbit constellation network slices using weighted undirected graphs of nodes and links. Virtual elements in network slice requests have specific computational and bandwidth requirements mapped to physical nodes through directed subgraph models.

DRL optimizes resource allocation and routing based on variables like load, delay, packet loss rate, and satellite positions, enhancing reliability. This approach ensures robustness by employing deep Q-network (DQN) -based methods with neural networks and experience replay to manage state-space complexities, complemented by adaptive node and link backup schemes for resilience against failures.

Validation of Network Reliability

The experimental validation of the reliability mapping method for 5G low orbit constellation network slices utilized a simulated environment, leveraging the cloud simulation for software-defined networking (CloudSimSDN) platform. This platform created a realistic network topology with 45 interconnected nodes arranged in a tree structure.

Various failure scenarios, including network equipment failures, satellite communication issues, and network congestion, were explored through simulations. The team monitored key metrics such as throughput, packet loss rate, and intra-slice traffic to assess the method's efficacy in swiftly recovering from failures and maintaining operational efficiency. The results demonstrated that the proposed method achieved rapid recovery times of less than 0.3 seconds with a 100% success rate in restoring normal network operations post-failure.

Comparative analyses with alternative methods underscored the superior performance of the proposed approach in managing increasing network slicing requests and accommodating SFCs of varying lengths (10 to 30) and up to 10 types of VNFs. These evaluations highlighted the method's capability to optimize network reliability and minimize delay under dynamic operational conditions. Overall, the findings suggest significant potential for enhancing the reliability and performance of 5G low orbit constellation networks, thereby contributing to advancements in future network architecture designs and deployments.

Conclusion

To sum up, the study addressed shortcomings in traditional network slice mapping by introducing a DRL approach tailored to the reliability needs of VNFs in 5G low orbit constellation networks. This method significantly improved network throughput, reduced traffic delay and packet loss rates, and optimized resource allocation for enhanced reliability and load balance. As network scale increased, the approach efficiently managed larger state spaces with high-performance computing resources like clusters or cloud platforms, ensuring scalability and effective strategy implementation.

Journal reference:
  • Xiao, Y., et al. (2024). Research on reliability mapping of 5G low orbit constellation network slice based on deep reinforcement learning. Scientific Reports, 14:1,15294. DOI:1038/s41598-024-66188-6, https://www.nature.com/articles/s41598-024-66188-6
Silpaja Chandrasekar

Written by

Silpaja Chandrasekar

Dr. Silpaja Chandrasekar has a Ph.D. in Computer Science from Anna University, Chennai. Her research expertise lies in analyzing traffic parameters under challenging environmental conditions. Additionally, she has gained valuable exposure to diverse research areas, such as detection, tracking, classification, medical image analysis, cancer cell detection, chemistry, and Hamiltonian walks.

Citations

Please use one of the following formats to cite this article in your essay, paper or report:

  • APA

    Chandrasekar, Silpaja. (2024, July 12). Ensuring Reliable 5G Networks with DRL. AZoAi. Retrieved on November 14, 2024 from https://www.azoai.com/news/20240712/Ensuring-Reliable-5G-Networks-with-DRL.aspx.

  • MLA

    Chandrasekar, Silpaja. "Ensuring Reliable 5G Networks with DRL". AZoAi. 14 November 2024. <https://www.azoai.com/news/20240712/Ensuring-Reliable-5G-Networks-with-DRL.aspx>.

  • Chicago

    Chandrasekar, Silpaja. "Ensuring Reliable 5G Networks with DRL". AZoAi. https://www.azoai.com/news/20240712/Ensuring-Reliable-5G-Networks-with-DRL.aspx. (accessed November 14, 2024).

  • Harvard

    Chandrasekar, Silpaja. 2024. Ensuring Reliable 5G Networks with DRL. AZoAi, viewed 14 November 2024, https://www.azoai.com/news/20240712/Ensuring-Reliable-5G-Networks-with-DRL.aspx.

Comments

The opinions expressed here are the views of the writer and do not necessarily reflect the views and opinions of AZoAi.
Post a new comment
Post

While we only use edited and approved content for Azthena answers, it may on occasions provide incorrect responses. Please confirm any data provided with the related suppliers or authors. We do not provide medical advice, if you search for medical information you must always consult a medical professional before acting on any information provided.

Your questions, but not your email details will be shared with OpenAI and retained for 30 days in accordance with their privacy principles.

Please do not ask questions that use sensitive or confidential information.

Read the full Terms & Conditions.

You might also like...
Scaling Large Language Models Makes Them Less Reliable, Producing Confident but Incorrect Answers