Elastic O-RAN Slicing for Industrial Monitoring and Control: A Distributed Matching Game and Deep Reinforcement Learning ApproachShow others and affiliations
2022 (English)In: IEEE Transactions on Vehicular Technology, ISSN 0018-9545, E-ISSN 1939-9359, Vol. 71, no 10, p. 10808-10822Article in journal (Refereed) Published
Abstract [en]
In this work, we design an elastic open radio access network (O-RAN) slicing for the Industrial Internet of things (IIoT). Due to the rapid spread of IoT in the industrial use-cases such as safety and mobile robot communications, the IIoT landscape has been shifted from static manufacturing processes towards dynamic manufacturing workflows (e.g., Modular Production System). But unlike IoT, IIoT poses additional challenges such as severe communication environment, network-slice resource demand variations, and on-time information update from the IIoT devices during industrial production. First, we formulate the O-RAN slicing problem for on-time industrial monitoring and control where the objective is to minimize the cost of fresh information updates (i.e., age of information (AoI)) from the IIoT devices (i.e., sensors) with the device energy consumption and O-RAN slice isolation constraints. Second, we propose the intelligent O-RAN framework based on game theory and machine learning to mitigate the problem’s complexity. We propose a two-sided distributed matching game in the O-RAN control layer that captures the IIoT channel characteristics and the IIoT service priorities to create IIoT device and small cell base station (SBS) preference lists. We then employ an actor-critic model with a deep deterministic policy gradient (DDPG) in the O-RAN service management layer to solve the resource allocation problem for optimizing the network slice configuration policy under time-varying slicing demand. Furthermore, the proposed matching game within the actor-critic model training helps to enforce the long-term policy-based guidance for resource allocation that reflects the trends of all IIoT devices and SBSs satisfactions with the assignment. Finally, the simulation results show that the proposed solution enhances the performance gain for the IIoT services by serving an average of <inline-formula><tex-math notation="LaTeX">$50\%$</tex-math></inline-formula> and <inline-formula><tex-math notation="LaTeX">$43.64\%$</tex-math></inline-formula> more IIoT devices than the baseline approaches.
Place, publisher, year, edition, pages
2022. Vol. 71, no 10, p. 10808-10822
Keywords [en]
5G mobile communication, age of information, deep reinforcement learning, Energy efficiency, game theory, Industrial Internet of Things, Industrial IoT, Monitoring, Network slicing, open RAN slicing, Quality of service, Resource management
National Category
Electrical Engineering, Electronic Engineering, Information Engineering
Identifiers
URN: urn:nbn:se:miun:diva-45750DOI: 10.1109/TVT.2022.3188217ISI: 000870332400047Scopus ID: 2-s2.0-85134243210OAI: oai:DiVA.org:miun-45750DiVA, id: diva2:1685412
2022-08-022022-08-022022-11-24Bibliographically approved