Service Function Chaining in NFV-Enabled Edge Networks with Natural Actor-Critic Deep Reinforcement Learning

Author(s):  
Ruijie Wang ◽  
Junhuai Li ◽  
Kan Wang ◽  
Xuan Liu ◽  
Xuan Lit
2021 ◽  
Vol 13 (11) ◽  
pp. 278
Author(s):  
Jesús Fernando Cevallos Moreno ◽  
Rebecca Sattler ◽  
Raúl P. Caulier Cisterna ◽  
Lorenzo Ricciardi Celsi ◽  
Aminael Sánchez Rodríguez ◽  
...  

Video delivery is exploiting 5G networks to enable higher server consolidation and deployment flexibility. Performance optimization is also a key target in such network systems. We present a multi-objective optimization framework for service function chain deployment in the particular context of Live-Streaming in virtualized content delivery networks using deep reinforcement learning. We use an Enhanced Exploration, Dense-reward mechanism over a Dueling Double Deep Q Network (E2-D4QN). Our model assumes to use network function virtualization at the container level. We carefully model processing times as a function of current resource utilization in data ingestion and streaming processes. We assess the performance of our algorithm under bounded network resource conditions to build a safe exploration strategy that enables the market entry of new bounded-budget vCDN players. Trace-driven simulations with real-world data reveal that our approach is the only one to adapt to the complexity of the particular context of Live-Video delivery concerning the state-of-art algorithms designed for general-case service function chain deployment. In particular, our simulation test revealed a substantial QoS/QoE performance improvement in terms of session acceptance ratio against the compared algorithms while keeping operational costs within proper bounds.


2021 ◽  
pp. 359-366
Author(s):  
Yaqiang Zhang ◽  
Ruyang Li ◽  
Zhangbing Zhou ◽  
Yaqian Zhao ◽  
Rengang Li

2020 ◽  
Vol 7 (6) ◽  
pp. 4746-4760
Author(s):  
Haoji Hu ◽  
Hangguan Shan ◽  
Chuankun Wang ◽  
Tengxu Sun ◽  
Xiaojian Zhen ◽  
...  

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 72985-72996
Author(s):  
Yaqiang Zhang ◽  
Zhangbing Zhou ◽  
Zhensheng Shi ◽  
Lin Meng ◽  
Zhenjiang Zhang

2021 ◽  
Author(s):  
Danyang Zheng ◽  
Gangxiang Shen ◽  
Yongcheng Li ◽  
Xiaojun Cao ◽  
Biswanath Mukherjee

<p>In the upcoming 5G-and-beyond era, ultra-reliable low-latency communication (URLLC) services will be ubiquitous in edge networks. To improve network performance and quality of service (QoS), URLLC services could be delivered via a sequence of software-based network functions, also known as service function chains (SFCs). Towards reliable SFC delivery, it is imperative to incorporate deterministic fault tolerance during SFC deployment. However, deploying an SFC with deterministic fault tolerance is challenging because the protection mechanism needs to consider protection against physical/virtual network failures and hardware/software failures jointly. Against multiple and diverse failures, this work investigates how to effectively deliver an SFC in optical edge networks with deterministic fault tolerance while minimizing wavelength resource consumption. We introduce a protection augmented graph, called <i>k</i>-connected service function slices layered graph (KC-SLG), protecting against <i>k</i>-1 fiber link failures and <i>k</i>-1 server failures. We formulate a novel problem called deterministic-fault-tolerant SFC embedding and propose an effective algorithm, called most candidate first SF slices layered graph embedding (MCF-SE). MCF-SE employs two proposed techniques: <i>k</i>-connected network slicing (KC-NS) and <i>k</i>-connected function slicing (KC-FS). Through thorough mathematical proof, we show that KC-NS is <i>2</i>-approximate. For KC-FS, we demonstrate that <i>k</i> = 3 provides the best cost-efficiency. Our experimental results also show that the proposed MCF-SE achieves deterministic-fault-tolerant service delivery and performs better than the schemes directly extended from existing work regarding survivability and average cost-efficiency.</p>


Sign in / Sign up

Export Citation Format

Share Document