An Adaptive Machine Learning Model for Heterogeneous Concept Drift Handling in Streaming Data

Authors

  • Deepa C. Mulimani Department of MCA, KLE Technological University, Hubballi, Karnataka, India
  • Prakashgoud R. Patil Department of MCA, KLE Technological University, Hubballi, Karnataka, India
Volume: 16 | Issue: 2 | Pages: 33672-33677 | April 2026 | https://doi.org/10.48084/etasr.17430

Abstract

The proliferation of streaming data in the present domain intrusion detection systems, financial applications, Internet of Things, and healthcare has transformed the requirements of machine learning applications. Concept drift is a difficult problem in these dynamic environments where the statistical properties of the data change over time, leading to the degradation of machine learning models. This problem is bigger in data streams with multiple classes. Present adaptive learning models are less effective in a variety of concept drift scenarios because they are reactive and have homogeneous drift detection. This article introduces the novel Weighted Adaptive Ensemble Method (WAEM) to overcome these drawbacks. The technique uses a set of different drift detectors and an ensemble of adaptive classifiers to capture the diverse drift events with a zero-detection delay. WAEM proactively responds to the distributional changes through dynamic weight adjustments that are driven by the individual classifier’s performance. Weighted probabilistic fusion and calibrated confidence are used to estimate the final predictions. Experiments on synthetic and real-world datasets show that WAEM performs better in terms of drift adaptation metrics and classification metrics than the three benchmark adaptive methods they were compared with.

Keywords:

machine learning, online classification, adaptive ensemble learning, concept drift detection, streaming data algorithms, network intrusion detection

Downloads

Download data is not yet available.

References

F. Hinder, V. Vaquet, and B. Hammer, "One or two things we know about concept drift—a survey on monitoring in evolving environments. Part A: detecting concept drift," Frontiers in Artificial Intelligence, vol. 7, Jun. 2024, Art. no. 1330257. DOI: https://doi.org/10.3389/frai.2024.1330257

X. Lin, L. Chang, X. Nie, and F. Dong, "Temporal Attention for Few-Shot Concept Drift Detection in Streaming Data," Electronics, vol. 13, no. 11, Jun. 2024, Art. no. 2183. DOI: https://doi.org/10.3390/electronics13112183

D. Joshi and M. Shukla, "An Ensemble Approach to Improve the Performance of Real Time Data Stream Classification," Engineering, Technology & Applied Science Research, vol. 14, no. 6, pp. 17749–17754, Dec. 2024. DOI: https://doi.org/10.48084/etasr.8563

S. Arora, R. Rani, and N. Saxena, "A systematic review on detection and adaptation of concept drift in streaming data using machine learning techniques," WIREs Data Mining and Knowledge Discovery, vol. 14, no. 4, 2024, Art. no. e1536. DOI: https://doi.org/10.1002/widm.1536

P. Wang, H. Yu, N. Jin, D. Davies, and W. L. Woo, "QuadCDD: A Quadruple-based Approach for Understanding Concept Drift in Data Streams," Expert Systems with Applications, vol. 238, Mar. 2024, Art. no. 122114. DOI: https://doi.org/10.1016/j.eswa.2023.122114

H. M. Gomes et al., "Adaptive random forests for evolving data stream classification," Machine Learning, vol. 106, pp. 1469–1495, Oct. 2017.

Y. Cao, Y. Ma, Y. Zhu, and K. M. Ting, "Revisiting streaming anomaly detection: benchmark and evaluation," Artificial Intelligence Review, vol. 58, no. 1, Nov. 2024, Art. no. 8. DOI: https://doi.org/10.1007/s10462-024-10995-w

A. Bifet and R. Gavalda, "Learning from Time-Changing Data with Adaptive Windowing," in Proceedings of the 2007 SIAM International Conference on Data Mining (SDM), 2007, pp. 443–448. DOI: https://doi.org/10.1137/1.9781611972771.42

M. Baena-García, J. del Campo-Ávila, R. Fidalgo, A. Bifet, R. Gavaldà, and R. Morales-Bueno, "Early drift detection method," 2006.

C. Raab, M. Heusinger, and F.-M. Schleif, "Reactive Soft Prototype Computing for Concept Drift Streams," Neurocomputing, vol. 416, pp. 340–351, Nov. 2020. DOI: https://doi.org/10.1016/j.neucom.2019.11.111

I. Frías-Blanco, J. del Campo-Ávila, G. Ramos-Jiménez, R. Morales-Bueno, A. Ortiz-Díaz, and Y. Caballero-Mota, "Online and Non-Parametric Drift Detection Methods Based on Hoeffding’s Bounds," IEEE Transactions on Knowledge and Data Engineering, vol. 27, no. 3, pp. 810–823, Mar. 2015. DOI: https://doi.org/10.1109/TKDE.2014.2345382

H. M. Gomes et al., "Adaptive random forests for evolving data stream classification," Machine Learning, vol. 106, no. 9, pp. 1469–1495, Oct. 2017. DOI: https://doi.org/10.1007/s10994-017-5642-8

H. M. Gomes, J. Read, and A. Bifet, "Streaming Random Patches for Evolving Data Stream Classification," in 2019 IEEE International Conference on Data Mining (ICDM), Beijing, China, Aug. 2019, pp. 240–249. DOI: https://doi.org/10.1109/ICDM.2019.00034

Md. A. Talukder et al., "Machine learning-based network intrusion detection for big and imbalanced data using oversampling, stacking feature embedding and feature extraction," Journal of Big Data, vol. 11, no. 1, Feb. 2024, Art. no. 33. DOI: https://doi.org/10.1186/s40537-024-00886-w

F. Folino, G. Folino, M. Guarascio, F. S. Pisani, and L. Pontieri, "On learning effective ensembles of deep neural networks for intrusion detection," Information Fusion, vol. 72, pp. 48–69, Aug. 2021. DOI: https://doi.org/10.1016/j.inffus.2021.02.007

Y. Chen, X. Yang, and H.-L. Dai, "Cost-sensitive continuous ensemble kernel learning for imbalanced data streams with concept drift," Knowledge-Based Systems, vol. 284, Jan. 2024, Art. no. 111272. DOI: https://doi.org/10.1016/j.knosys.2023.111272

A. Cano and B. Krawczyk, "ROSE: robust online self-adjusting ensemble for continual learning on imbalanced drifting data streams," Machine Learning, vol. 111, no. 7, pp. 2561–2599, Jul. 2022. DOI: https://doi.org/10.1007/s10994-022-06168-x

Y. Sun, Y. Yu, C. Jin, Q. Zhang, W. Liu, and H. Yu, "Graph-Based Competence Model for Concept Drift Detection," in 2023 18th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), Fuzhou, China, Aug. 2023, pp. 529–536. DOI: https://doi.org/10.1109/ISKE60036.2023.10481075

D. Mulimani, S. G. Kanakaraddi, S. G. Totad, and P. R. Patil, "Weighted Averaging Ensemble Model for Concept Drift Adaptation in Streaming Data," in 2022 2nd International Conference on Intelligent Technologies (CONIT), Hubli, India, Jun. 2022, pp. 1–8. DOI: https://doi.org/10.1109/CONIT55038.2022.9848151

J. Gama, R. Sebastião, and P. P. Rodrigues, "On evaluating stream learning algorithms," Machine Learning, vol. 90, no. 3, pp. 317–346, Mar. 2013. DOI: https://doi.org/10.1007/s10994-012-5320-9

I. Sharafaldin, A. Habibi Lashkari, and A. A. Ghorbani, "Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization:," in Proceedings of the 4th International Conference on Information Systems Security and Privacy, Funchal, Madeira, Portugal, 2018, pp. 108–116. DOI: https://doi.org/10.5220/0006639801080116

M. Tavallaee, E. Bagheri, W. Lu, and A. A. Ghorbani, "A detailed analysis of the KDD CUP 99 data set," in 2009 IEEE Symposium on Computational Intelligence for Security and Defense Applications, Ottawa, ON, Canada, Jul. 2009, pp. 1–6. DOI: https://doi.org/10.1109/CISDA.2009.5356528

V. M. A. Souza, D. M. dos Reis, A. G. Maletzke, and G. E. A. P. A. Batista, "Challenges in benchmarking stream learning algorithms with real-world data," Data Mining and Knowledge Discovery, vol. 34, no. 6, pp. 1805–1858, Nov. 2020. DOI: https://doi.org/10.1007/s10618-020-00698-5

A. Bifet, G. Holmes, R. Kirkby, and B. Pfahringer, "MOA: massive online analysis," Journal of Machine Learning Research, vol. 11, pp. 1601–1604, 2010.

Downloads

How to Cite

[1]
D. C. Mulimani and P. R. Patil, “An Adaptive Machine Learning Model for Heterogeneous Concept Drift Handling in Streaming Data”, Eng. Technol. Appl. Sci. Res., vol. 16, no. 2, pp. 33672–33677, Apr. 2026.

Metrics

Abstract Views: 88
PDF Downloads: 53

Metrics Information