scholarly journals Reinforcement Learning for Joint Channel/Subframe Selection of LTE in the Unlicensed Spectrum

2021 ◽  
Vol 2021 ◽  
pp. 1-15
Author(s):  
Yuki Kishimoto ◽  
Xiaoyan Wang ◽  
Masahiro Umehira
Keyword(s):  
Reinforcement Learning ◽  
Data Traffic ◽  
Spectrum Utilization ◽  
Unlicensed Spectrum ◽  
Selection Scheme ◽  
System A ◽  
Traffic Loads ◽  
Lte Advanced ◽  
Joint Channel ◽  
Selection Of

In recent years, to cope with the rapid growth in mobile data traffic, increasing the capacity of cellular networks is receiving more and more attention. To this end, offloading the current LTE-advanced or 5G system’s data traffic from licensed spectrum to the unlicensed spectrum that is used by WiFi systems, i.e., LTE-Licensed-Assisted-Access (LTE-LAA), has been extensively investigated. In the current LTE-LAA system, a Listen-Before-Talk (LBT) approach is implemented, which requires the LTE user also perform carrier sense before the transmission. However, fair LTE-WiFi coexistence is still hard to guarantee due to their unbalanced frame sizes and traffic loads. In the LTE-LAA system, the optimal channel selection and subframe number adjustment are the keys to realize efficient spectrum utilization and fair system coexistence. To this end, in this paper, we propose a reinforcement learning-based joint channel/subframe selection scheme for LTE-LAA. The proposed approach is implemented at the LTE access points with zero knowledge of the WiFi systems. The results of extensive simulations verify that the proposed approach can significantly improve the fairness and packet loss rate compared with baseline schemes.

scholarly journals Sensitivity Based Selection of an Optimal Cable-Driven Parallel Robot Design for Rehabilitation Purposes

Robotics ◽  
2020 ◽  
Vol 10 (1) ◽  
pp. 7
Author(s):  
Ferdaws Ennaiem ◽  
Abdelbadiâ Chaker ◽  
Juan Sebastián Sandoval Arévalo ◽  
Med Amine Laribi ◽  
Sami Bennour ◽  
...  
Keyword(s):  
Pareto Front ◽  
Parallel Robot ◽  
Elastic Stiffness ◽  
Upper Limb Rehabilitation ◽  
Daily Life Activities ◽  
System A ◽  
The Monte Carlo Method ◽  
Genetic Algorithm Method ◽  
Limb Rehabilitation ◽  
Selection Of

This paper deals with the design of an optimal cable-driven parallel robot (CDPR) for upper limb rehabilitation. The robot’s prescribed workspace is identified with the help of an occupational therapist based on three selected daily life activities, which are tracked using a Qualisys motion capture system. A preliminary architecture of the robot is proposed based on the analysis of the tracked trajectories of all the activities. A multi-objective optimization process using the genetic algorithm method is then performed, where the cable tensions and the robot size are selected as the objective functions to be minimized. The cables tensions are bounded between two limits, where the lower limit ensures a positive tension in the cables at all times and the upper limit represents the maximum torque of the motor. A sensitivity analysis is then performed using the Monte Carlo method to yield the optimal design selected out of the non-dominated solutions, forming the obtained Pareto front. The robot with the highest robustness toward the disturbances is identified, and its dexterity and elastic stiffness are calculated to investigate its performance.

scholarly journals Interference Cancellation Based Spectrum Sharing for Massive MIMO Communication Systems

Sensors ◽  
2021 ◽  
Vol 21 (11) ◽  
pp. 3584
Author(s):  
Milembolo Miantezila Junior ◽  
Bin Guo ◽  
Chenjie Zhang ◽  
Xuemei Bai
Keyword(s):  
Interference Cancellation ◽  
Communication Systems ◽  
Spectrum Sharing ◽  
Null Space ◽  
Base Station ◽  
Base Stations ◽  
Small Cells ◽  
Data Traffic ◽  
New Approach ◽  
Lte Advanced

Cellular network operators are predicting an increase in space of more than 200 percent to carry the move and tremendous increase of total users in data traffic. The growing of investments in infrastructure such as a large number of small cells, particularly the technologies such as LTE-Advanced and 6G Technology, can assist in mitigating this challenge moderately. In this paper, we suggest a projection study in spectrum sharing of radar multi-input and multi-output, and mobile LTE multi-input multi-output communication systems near m base stations (BS). The radar multi-input multi-output and mobile LTE communication systems split different interference channels. The new approach based on radar projection signal detection has been proposed for free interference disturbance channel with radar multi-input multi-output and mobile LTE multi-input multi-output by using a new proposed interference cancellation algorithm. We chose the channel of interference with the best free channel, and the detected signal of radar was projected to null space. The goal is to remove all interferences from the radar multi-input multi-output and to cancel any disturbance sources from a chosen mobile Communication Base Station. The experimental results showed that the new approach performs very well and can optimize Spectrum Access.

scholarly journals An Analytical Approach for the Selection of Technologies to be Integrated in a Plug&play Façade Unit: The RenoZEB Case Study

Proceedings ◽  
2021 ◽  
Vol 65 (1) ◽  
pp. 29
Author(s):  
Alessandro Pracucci ◽  
Sara Magnani ◽  
Laura Vandi ◽  
Oscar Casadei ◽  
Amaia Uriarte ◽  
...  
Keyword(s):  
Building Envelope ◽  
Design System ◽  
Decision Matrix ◽  
Design Guideline ◽  
Existing Building ◽  
Building Conditions ◽  
Zero Energy Building ◽  
System A ◽  
Selection Of

The nearly Zero Energy building (nZEB) renovation market is currently the key feature in the construction sector. RenoZEB aims to develop a systematic approach for retrofitting by assembling different technologies in a plug and play building envelope. This paper presents the methodology used to transform the RenoZEB concept in the design system. A multi-criteria decision matrix is used for the selection of the best façade technologies within the market while the analysis of the existing building conditions allows to develop a replicable approach for designing deep retrofitting intervention through a plug&play façade. The methodology appears to be a valuable support for the selection of technologies and allows to define a design guideline for the envelope.

Modeling human-like longitudinal driver model for intelligent vehicles based on reinforcement learning

2021 ◽  
pp. 095440702098357
Author(s):  
Ju Xie ◽  
Xing Xu ◽  
Feng Wang ◽  
Haobin Jiang
Keyword(s):  
Reinforcement Learning ◽  
Comprehensive Evaluation ◽  
Path Following ◽  
Intelligent Vehicles ◽  
Driver Model ◽  
Control Center ◽  
Training Performance ◽  
Learning Agents ◽  
System A ◽  
And Control

The driver model is the decision-making and control center of intelligent vehicle. In order to improve the adaptability of intelligent vehicles under complex driving conditions, and simulate the manipulation characteristics of the skilled driver under the driver-vehicle-road closed-loop system, a kind of human-like longitudinal driver model for intelligent vehicles based on reinforcement learning is proposed. This paper builds the lateral driver model for intelligent vehicles based on optimal preview control theory. Then, the control correction link of longitudinal driver model is established to calculate the throttle opening or brake pedal travel for the desired longitudinal acceleration. Moreover, the reinforcement learning agents for longitudinal driver model is parallel trained by comprehensive evaluation index and skilled driver data. Lastly, training performance and scenarios verification between the simulation experiment and the real car test are performed to verify the effectiveness of the reinforcement learning based longitudinal driver model. The results show that the proposed human-like longitudinal driver model based on reinforcement learning can help intelligent vehicles effectively imitate the speed control behavior of the skilled driver in various path-following scenarios.

Sign in / Sign up

Export Citation Format

Share Document