Machine Learning-Driven Handover Optimization in LTE networks

Quality Signal Indicator, Classifier-Based Prediction Analysis and Hybrid Q-Learning

Objective

To develop a machine learning-driven framework for optimizing handover management in LTE networks by integrating Quality Signal Indicator (QSI) classification, supervised learning-based handover prediction, and hybrid Q-learning optimization, aiming to minimize unnecessary handovers, enhance signal stability, and improve overall network performance using real-world drive test data.

Background

In the fast-paced world of mobile communications, Long-Term Evolution (LTE) networks form the backbone of seamless connectivity, supporting everything from video streaming to critical real-time applications. However, as users move through dynamic environments—like bustling city streets or high-speed highways—maintaining uninterrupted service becomes a challenge. Handovers, the process of transferring a user's connection between base stations, are critical to ensuring continuous connectivity. Traditional handover methods, reliant on static signal strength thresholds, often lead to inefficiencies such as unnecessary handovers or delayed transitions, resulting in dropped calls, increased latency, and degraded user experience. With the growing complexity of mobile networks and the advent of data-driven technologies, there is a pressing need for intelligent, adaptive solutions to optimize handover decisions.

Motivation

Our journey began with a shared passion for leveraging artificial intelligence to solve real-world problems in telecommunications. As students of Artificial Intelligence at the Islamic University of Technology, we observed how the increasing demand for seamless connectivity in LTE networks was often hampered by outdated handover strategies. This sparked a question: Could machine learning and reinforcement learning transform handover management to deliver a smoother, more reliable user experience?

Where we started

We identified a gap in traditional handover approaches, which struggled to adapt to dynamic network conditions and lacked the predictive power of modern data analytics. The scarcity of real-world datasets further motivated us to conduct drive tests in Dhaka, capturing live LTE signal data to build a robust foundation for our research.

What we built

We developed a machine learning-driven framework that integrates three key components: a Quality Signal Indicator (QSI) for signal quality assessment, supervised learning models for handover prediction, and a hybrid Q-learning approach for optimization. By combining real-world data with advanced algorithms, we aimed to minimize unnecessary handovers while ensuring seamless connectivity.

What we found

Our framework significantly reduced redundant handovers—from 97 to 71 in our dataset—while maintaining signal stability. The supervised models, particularly Random Forest and XGBoost, excelled in predicting handover events, with high recall ensuring critical handovers were not missed. The hybrid Q-learning approach further refined decision-making, balancing exploration and exploitation to optimize network performance.

What's next

This project is just the beginning. We envision extending our framework to 5G networks, incorporating additional parameters like latency and throughput for holistic optimization. By integrating with Self-Organizing Networks and edge computing, we aim to create scalable, real-time solutions that empower next-generation mobile networks.

Why it matters

This project matters to us because it bridges the gap between theoretical AI and practical network challenges, paving the way for smarter, more efficient communication systems. Our objective was clear: to harness machine learning and reinforcement learning to enhance handover efficiency, reduce network overhead, and improve user experience in LTE networks. Through this work, we hope to contribute to the evolution of intelligent, self-optimizing networks that keep the world connected, no matter where users roam.

Motivation 1

Research Components

Overview

In this research, three distinct methodologies were employed to optimize handover management in LTE networks. For the Quality Signal Indicator (QSI) analysis, real-time signal metrics such as Reference Signal Received Power (RSRP), Reference Signal Received Quality (RSRQ), and Carrier-to-Interference-plus-Noise Ratio (CINR) were categorized into four levels—Excellent, Good, Moderate, and Poor—using percentile-based thresholding and unsupervised K-means clustering. This approach, enhanced by Principal Component Analysis (PCA) for dimensionality reduction, enabled robust signal quality assessment through self-supervised learning with nine machine learning classifiers, achieving high accuracy with models like Logistic Regression and SVM. For handover prediction, ten supervised classification models, including Random Forest and XGBoost, were trained on drive test data to predict potential handover events, addressing dataset imbalance with techniques like Random Undersampling, SMOTE, and Tomek Links, and prioritizing recall to minimize missed handovers. Finally, handover optimization was achieved through a hybrid Q-learning framework that integrated Logistic Regression-based action selection with reinforcement learning, reducing unnecessary handovers from 97 to 71 by iteratively updating a Q-table with a reward function designed to penalize poor handover decisions and reward optimal transitions, thereby enhancing network stability and efficiency.

Quality Signal Indicator (QSI)

The Quality Signal Indicator (QSI) analysis utilized three features—serving cell RSRP, RSRQ, and CINR—to assess signal quality, categorizing it into four groups: Excellent (>90% quantile), Good (>50%), Moderate (>15%), and Poor (0-15%) using self-supervised learning with percentile-based thresholding. Nine machine learning classifiers were evaluated, with Logistic Regression and SVM achieving the highest accuracy, while AdaBoost performed poorly. Principal Component Analysis (PCA) was applied to reduce dimensionality, followed by K-means clustering with manually initialized centroids based on domain knowledge, to refine signal quality classification. The clustering results, visualized via scatter plots, showed clear category separation, with centroid positions extracted for each group, enabling a robust, data-driven framework for signal quality assessment in LTE networks.

QSI Analysis 1
QSI Analysis 2
QSI Analysis 3
QSI Analysis 4

Classifier-Based Prediction Analysis

The evaluation of the handover prediction model utilized key metrics to assess performance: Precision (TP / (TP + FP)) measures the proportion of correctly predicted positive instances, crucial for minimizing false positives in applications like fraud detection. Recall (TP / (TP + FN)) evaluates the model's ability to identify actual positive cases, vital for scenarios like disease screening where missing positives is costly. F1-score, the harmonic mean of precision and recall (2 × (Precision × Recall) / (Precision + Recall)), balances both metrics, making it ideal for imbalanced datasets. Accuracy ((TP + TN) / (TP + TN + FP + FN)) reflects overall correctness but can be misleading in imbalanced datasets. Ten classification algorithms were tested, incorporating imbalance handling techniques, with performance compared against a baseline model using accuracy, precision, recall, and F1-score, providing insights into the proposed model's effectiveness in enhancing handover prediction.

Classifier Analysis 1
Classifier Analysis 2
Classifier Analysis 3
Classifier Analysis 4
Classifier Analysis 5
Classifier Analysis 6
Classifier Analysis 7
Classifier Analysis 8
Classifier Analysis 9
Classifier Analysis 10

The confusion matrices of each classifier are shown for better understanding in the following figures.The left matrix is for baseline model and the right matrix is for proposed model.

Logistic Regression

Logistic Regression Matrix 1
Logistic Regression Matrix 2

Decision Tree

Decision Tree Matrix 1
Decision Tree Matrix 2

Random Forest

Random Forest Matrix 1
Random Forest Matrix 2

KNN

KNN Matrix 1
KNN Matrix 2

SVM

SVM Matrix 1
SVM Matrix 2

Naive Bayes

Naive Bayes Matrix 1
Naive Bayes Matrix 2

AdaBoost

AdaBoost Matrix 1
AdaBoost Matrix 2

CatBoost

CatBoost Matrix 1
CatBoost Matrix 2

XGBoost

XGBoost Matrix 1
XGBoost Matrix 2

GradientBoost

GradientBoost Matrix 1
GradientBoost Matrix 2

Hybrid Q-Learning Optimization

To minimize unnecessary handovers and enhance signal quality for moving User Equipment (UE) in LTE networks, a hybrid learning framework combining supervised learning and Q-learning was developed. This model refines handover decisions by integrating a reward function that penalizes poor handovers (based on RSRP, RSRQ, and CINR) and rewards optimal transitions, promoting network stability. During training with 647 data points, the model recorded 276 handover events, refining its policy iteratively. In the evaluation phase, handovers were reduced from 94 to 71, demonstrating effective suppression of redundant transitions while maintaining connectivity. This approach reduces signaling overhead, latency, and energy consumption, improving Quality of Service (QoS) and network efficiency, with potential for extension to 5G networks.

Q-Learning Framework

Conclusion

This research successfully developed and implemented a machine learning-driven framework to optimize handover management in LTE networks, achieving significant improvements in network efficiency and user experience. By integrating Quality Signal Indicator (QSI) classification, supervised learning-based handover prediction, and hybrid Q-learning optimization, the project reduced unnecessary handovers from 97 to 71 while maintaining seamless connectivity. The QSI analysis provided a robust signal quality assessment, the predictive models ensured high recall to capture critical handover events, and the Q-learning approach enhanced decision-making through a reward-based mechanism. These outcomes demonstrate the power of combining machine learning and reinforcement learning to address real-world telecommunications challenges. The framework lays a strong foundation for future advancements, with potential applications in 5G and beyond, paving the way for intelligent, adaptive, and self-optimizing mobile networks that deliver reliable connectivity in dynamic environments.

About Us

K M ISTIAQUE

Student ID: 200021220

SADMAN SHAFI IFTY

Student ID: 200021240

SHAFAYET SADIK SOWAD

Student ID: 200021248