Tachyon: Enhancing stacked models using Bayesian optimization for intrusion detection using different sampling approaches
Article, Egyptian Informatics Journal, 2024, DOI Link
View abstract ⏷
The integration of sensors in the monitoring of essential bodily measurements, air quality, and energy consumption in buildings demonstrates the importance of the Internet of Things (IoT) in everyday life. These security breaches are caused by rudimentary and immature security protocols that are implemented on IoT devices. An intrusion detection system is used to detect security threats and system-level applications to detect malicious activities. This paper introduces Tachyon, a combination of various statistical and tree-based Artificial Intelligence (AI) techniques, such as Extreme Gradient Boosting (XGBoost), Random Forest (RF), Bidirectional Auto-Regressive Transformers (BART), Logistic Regression (LR), Multivariate Adaptive Regression Splines (MARS), Decision Tree (DT), and a top k stack ensemble to distinguish between normal and malicious attacks in a binary classification setting. The IoTID2020 dataset used in this study consists of 6,25,783 samples with 83 features. An initial examination of the data reveals its unbalanced nature. To create a balanced dataset, a range of sampling techniques were used, including Oversampling, Undersampling, Synthetic Minority Oversampling Technique (SMOTE), Random Oversampling Examples (ROSE), Borderline Synthetic Minority Oversampling Technique (b-SMOTE), and Adaptive Synthetic (ADASYN). In addition, principal component analysis (PCA) and partial least squares (PLS) were used to determine the most significant features. The experimental results demonstrate that the stacked ensemble achieved a performance of 99.8%, which is better than the baseline approaches. An ablation study of ensemble models was also conducted to assess the performance of the proposed model in various scenarios.
Optimized Tree-based Ensembles for Intrusion Detection in Internet of Things
Conference paper, International Symposium on Advanced Networks and Telecommunication Systems, ANTS, 2023, DOI Link
View abstract ⏷
The Internet of Things (IoT) is one of the most widely used technologies in the world and security is a major threat to IoT networks. In this paper, we propose and implement a machine learning (ML) approach to design an intrusion detection and classification system (IDS) to detect cyber threats. The proposed work uses a novel feature selection approach, which indicates the most significant attributes from the high-dimensionality data. We use the Whale Optimization Algorithm (WOA) and the Genetic Algorithm (GA) for feature selection and the Simulated Annealing (SA) algorithm to optimize the model's hyperparameters. We have applied the models in the IoT Intrusion Dataset 2020 (IoTID20) dataset to assess the effectiveness and sustainability of our proposed strategy. The results are concluded after performing the optimization algorithm on both the Extreme Gradient Boosting (XGBoost) and light gradient-boosting machine (LightGBM) models, we have achieved the highest accuracy of 99.2% with simulated annealing optimization on the WOA-selected features. In addition, we provide a complete development environment, validation environment, configurations, and extensive simulation results to better understand the proposed solution methodology.