https://www.mdu.se/

mdu.sePublications
Change search
Link to record
Permanent link

Direct link
Publications (10 of 62) Show all publications
Ahmed, M. U., Hurter, C., Barua, S., Begum, S., Arico, P., Baranzini, D. & Cavagnetto, N. (2026). Bias-Aware Generative XAI for Sustainable Air Traffic Control: A Methodological Framework with Predictive Telemetry. In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies: . Paper presented at 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia (pp. 6-13). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Bias-Aware Generative XAI for Sustainable Air Traffic Control: A Methodological Framework with Predictive Telemetry
Show others...
2026 (English)In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, Association for Computing Machinery (ACM) , 2026, p. 6-13Conference paper, Published paper (Refereed)
Abstract [en]

Artificial Intelligence (AI) is reshaping decision-making across industries, but in life-critical domains like Air Traffic Control (ATC), performance alone is not enough - AI must also be transparent, accountable, and human-centered. At the same time, ecological sustainability (e.g., fuel efficiency, emissions reduction, noise abatement) is becoming a key operational priority. Yet under high workload or time pressure, these goals are often deprioritized. This paper introduces a novel framework for bias-aware human-AI teaming in ATC, integrating Generative Explainable AI (genXAI), Predictive Telemetry (PT), multimodal machine learning, and mechanistic interpretability. Designed for Air Traffic Controllers (ATCOs), the system anticipates future traffic states, detects bias-prone conditions, and delivers adaptive, context-sensitive explanations. Through bias-aware interfaces, serious-game training, and neuroadaptive feedback loops, the framework aligns decision support with cognitive state and operational complexity. The framework targets three key objectives: (1) mitigating cognitive biases, (2) improving ground routing decisions, and (3) validating anticipatory AI models. By reframing sustainability as a human-AI collaboration challenge, this work advances a new class of trustworthy, bias-aware AI that enhances both safety and ecological performance in Air Traffic Management (ATM). 

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2026
Keywords
Air Traffic Controllers, Air Traffic Management, Artificial Intelligence, Cognitive bias modelling, Generative Explainable AI, Mechanistic Interpretability, Multimodal Machine Learning, Predictive Telemetry, Advanced traffic management systems, Air navigation, Air transportation, Behavioral research, Cognitive systems, Computer aided software engineering, Decision making, Decision support systems, Digital avionics, Emission control, Interactive computer systems, Learning systems, Machine learning, Noise abatement, Telemetering, Air traffic controller, Bias modeling, Cognitive bias, Cognitive bias modeling, Generative explainable artificial intelligence, Interpretability, Machine-learning, Mechanistics, Multi-modal, Air traffic control
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-77531 (URN)10.1145/3795496.3795708 (DOI)2-s2.0-105037586298 (Scopus ID)9798400721526 (ISBN)
Conference
2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia
Available from: 2026-06-11 Created: 2026-06-11 Last updated: 2026-06-11Bibliographically approved
Salwa Rabbi Nishat, T., Barua, S., Ahmed, M. U. & Begum, S. (2026). Enhancing Random Forest Using Genetic Algorithm for Lifelong Machine Learning. IEEE Access, 14, 6310-6325
Open this publication in new window or tab >>Enhancing Random Forest Using Genetic Algorithm for Lifelong Machine Learning
2026 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 14, p. 6310-6325Article in journal (Refereed) Published
Abstract [en]

Learning over time for machine learning (ML) models is emerging as a new field, often called continual learning or lifelong Machine learning (LML). Today, deep learning and neural networks are the prevalent approaches for LML models. However, they are often criticized for being “black box” methods, and catastrophic forgetting has remained a persistent challenge throughout their development. This paradigm represents a significant shift from traditional static learning models, enabling systems to adapt to new data continuously while retaining previously acquired knowledge. In this paper, an LML approach is proposed that combines a Random Forest (RF) with a Genetic Algorithm (GA) to transfer the knowledge from an existing RF model to a new learning model. Here, the GA is applied to the RF model so that the weights of this model get balanced more steadily. The approach is evaluated here for classification problems on three benchmark datasets. The initial results present knowledge retention in the new model, indicating the success of the model. These methods are regularization-based and effective in mitigating catastrophic forgetting. However, they rely on Fisher Information to estimate parameter importance or similar measures, which are computationally demanding and suitable for deep neural networks. While many NN-based lifelong learning approaches have been studied, RFs remain comparatively underexplored in this paradigm. Given their robustness, interpretability, and effectiveness in tabular datasets with limited samples, RFs present a compelling alternative. This motivates our work on developing an RF-based lifelong learning approach. 

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2026
Keywords
genetic algorithm, lifelong learning, Lifelong machine learning, random forest
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-75632 (URN)10.1109/ACCESS.2026.3651601 (DOI)001663376800011 ()2-s2.0-105027662643 (Scopus ID)
Available from: 2026-01-28 Created: 2026-01-28 Last updated: 2026-06-12Bibliographically approved
Billah, M., Ahmed, M. U., Barua, S., Leberruyer, N. & Begum, S. (2026). Evaluating AI Agent prompting and fine-tuning strategies for structured data extraction from industrial PDFs. Array, 31, Article ID 101118.
Open this publication in new window or tab >>Evaluating AI Agent prompting and fine-tuning strategies for structured data extraction from industrial PDFs
Show others...
2026 (English)In: Array, E-ISSN 2590-0056, Vol. 31, article id 101118Article in journal (Refereed) Published
Abstract [en]

Industrial environments generate large volumes of heterogeneous, unstructured PDF documents, such as material certificates, making reliable automated data extraction a methodological challenge. Traditional LLM-based pipelines often struggle with noisy OCR output, inconsistent layouts, and schema variability, leading to unstable outputs and reduced accuracy. This study addresses the problem of designing a robust, consistent extraction pipeline capable of operating across diverse document structures under both limited and scaled domain-specific supervision regimes. We propose a coordinated multi-agent framework integrating layout-aware OCR processing, expert-guided prompt engineering, systematic prompt refinement, controlled synthetic dataset expansion, and parameter-efficient adaptation via LoRA. The architecture includes specialised agents for raw text extraction, dataset preparation, prompt optimisation, LoRA configuration search, output processing, and structured evaluation, forming an iterative workflow that improves stability and reduces error propagation. Structural compliance and retrieval accuracy are evaluated separately using binomial modelling with Wilson confidence intervals. Zero-shot, few-shot, and LoRA fine-tuned LLMs are assessed across commercial and open-weight models. Results show that few-shot prompting enables rapid structural alignment under low-resource conditions, while fine-tuning effectiveness depends on supervision diversity. Merged supervision, defined as fine-tuning on combined original and synthetic certificates (FT-Merged), substantially outperforms limited-scale LoRA adaptation. Under FT-Merged, Mistral 7B achieves 97.05% retrieval accuracy with near-perfect structural compliance, approaching commercial reliability. GPT-4o and DeepSeek Chat achieve approximately 99% accuracy without task-specific fine-tuning. Cross-domain validation confirms structural generalisation, and runtime-cost analysis highlights trade-offs between accuracy, latency, financial cost, and deployment control. Overall, robust industrial extraction emerges from coordinated architectural orchestration rather than model choice alone. © 2026

Place, publisher, year, edition, pages
Elsevier BV, 2026
Keywords
AI Agent, Data extraction, Large language models, Unstructured sources, Cost accounting, Cost benefit analysis, Extraction, Iterative methods, Mergers and acquisitions, Multi agent systems, Text processing, Tuning, Fine tuning, Industrial environments, Language model, Large language model, Retrieval accuracy, Structured data, Tuning strategy, Unstructured source, Economic and social effects
National Category
Natural Language Processing
Identifiers
urn:nbn:se:mdh:diva-78789 (URN)10.1016/j.array.2026.101118 (DOI)001847277300001 ()2-s2.0-105046726576 (Scopus ID)
Available from: 2026-08-21 Created: 2026-08-21 Last updated: 2026-08-21Bibliographically approved
Cartocci, G., Veyrié, A., Cavagnetto, N., Hurter, C., Degas, A., Ferreira, A., . . . Aricò, P. (2026). Explainable artificial intelligence in air traffic control: effects of expertise on workload, acceptance, and usage intentions. Brain Informatics
Open this publication in new window or tab >>Explainable artificial intelligence in air traffic control: effects of expertise on workload, acceptance, and usage intentions
Show others...
2026 (English)In: Brain Informatics, ISSN 2198-4018, E-ISSN 2198-4026Article in journal (Refereed) Published
Abstract [en]

Explainability is crucial for establishing user trust in Artificial Intelligence (AI), particularly within safety-critical domains such as Air Traffic Management (ATM) and Air Traffic Control (ATC). This study empirically investigates the effects of Explainable AI (XAI), specifically HeatMap-based visual explanations, on cognitive workload, user acceptance, and intention to use AI-driven decision-support systems among Air Traffic Control Officers (ATCOs). Despite significant theoretical advancements in the broader XAI domain, empirical evidence addressing the specific impact of visual explanations on human-AI interactions in safety-critical environments like ATC remains limited. To address these critical gaps, an experimental comparison was conducted between explainable (HeatMap) and non-explainable (BlackBox) AI conditions, involving two user groups: expert and student ATCOs. Both objective neurophysiological measures (Electroencephalography) and subjective questionnaires were employed to capture comprehensive user responses. Key findings revealed that the presence of visual explanations significantly reduced cognitive workload and enhanced users' willingness to adopt the AI system, regardless of participants' level of expertise. However, explicit perceptions of AI's impact on work performance were predominantly influenced by expertise, with less experienced controllers reporting a greater perceived impact than their expert counterparts. By combining objective neurometrics with subjective user assessments, this research advances methodological rigor in evaluating human-AI interactions and highlights the importance of tailored, user-centric explanations. These findings directly contribute to practical guidelines for designing cognitively compatible and trustworthy AI tools in ATC, providing nuanced insights for targeted training and deployment strategies based on user expertise. 

Place, publisher, year, edition, pages
Springer Nature, 2026
Keywords
Air traffic control, Electroencephalography, Expertise, Explainable artificial intelligence, Workload
National Category
Computer Systems
Identifiers
urn:nbn:se:mdh:diva-75793 (URN)10.1186/s40708-025-00287-6 (DOI)001712162500001 ()41579282 (PubMedID)2-s2.0-105033819242 (Scopus ID)
Funder
Mälardalen UniversityMälardalen University
Available from: 2026-02-06 Created: 2026-02-06 Last updated: 2026-07-02Bibliographically approved
Shkarpa, A., Barua, S., Begum, S. & Ahmed, M. U. (2026). Hybrid Neuro-Fuzzy Approach for Transparent Anomaly Detection in Mining Equipment. In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies: . Paper presented at 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia (pp. 36-43). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Hybrid Neuro-Fuzzy Approach for Transparent Anomaly Detection in Mining Equipment
2026 (English)In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, Association for Computing Machinery (ACM) , 2026, p. 36-43Conference paper, Published paper (Refereed)
Abstract [en]

Predictive maintenance is critical for minimizing downtime and operational costs in mining industries, where slurry pumps operate under abrasive and highly variable conditions. Traditional machine learning models, while accurate, often lack interpretability, limiting their adoption in safety-critical environments. This paper presents an Adaptive Neuro-Fuzzy Inference System (ANFIS) based approach for anomaly detection in slurry pumps using vibration-based features such as displacement, velocity, crest factor, kurtosis, skewness, peak, and peak-to-peak values. ANFIS combines the transparency of fuzzy logic with the learning capability of neural networks, enabling interpretable IF-THEN rules and adaptive tuning of membership functions. A dataset of 33,104 vibration samples was analyzed under four balancing strategies to address class imbalance. Models were evaluated using accuracy, precision, recall, F1-score, RMSE, and clustering quality metrics (Dunn Index and Silhouette Score). The results demonstrate that ANFIS achieves high accuracy (>99%) and strong interpretability, outperforming traditional black-box models. The proposed approach enhances trustworthiness and adaptability in predictive maintenance systems, offering an explainable solution for Industry 4.0 applications. Future work will explore hybrid models, real-time IoT integration, and edge deployment for dynamic operational environments.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2026
Keywords
Adaptive Neuro-Fuzzy Inference System (ANFIS), Anomaly Detection, Condition Monitoring, Explainable AI, Industry 4.0, Mining Industry, Predictive Maintenance, Vibration Analysis, Balancing, Data mining, Fuzzy inference, Fuzzy neural networks, Fuzzy systems, Higher order statistics, Learning systems, Membership functions, Adaptive neuro-fuzzy inference, Adaptive neuro-fuzzy inference system, Condition, Interpretability, Neuro-fuzzy inference systems, Slurry pumps, Vibrations analysis
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-77532 (URN)10.1145/3795496.3795711 (DOI)2-s2.0-105037604766 (Scopus ID)9798400721526 (ISBN)
Conference
2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia
Available from: 2026-06-11 Created: 2026-06-11 Last updated: 2026-06-11Bibliographically approved
Kabir, M. M., Barua, S., Ahmed, M. U., Nourozi, B., Begum, S. & Bel Fdhila, R. (2026). Physics-Constrained Machine Learning Framework for Parametric Optimization of Industrial Cooling Systems. In: International Conference on Agents and Artificial Intelligence: . Paper presented at 18th International Conference on Agents and Artificial Intelligence, ICAART 2026, Marbella, Spain, 5-8 March, 2026 (pp. 3526-3537). INSTICC
Open this publication in new window or tab >>Physics-Constrained Machine Learning Framework for Parametric Optimization of Industrial Cooling Systems
Show others...
2026 (English)In: International Conference on Agents and Artificial Intelligence, INSTICC , 2026, p. 3526-3537Conference paper, Published paper (Refereed)
Abstract [en]

High-voltage direct current (HVDC) systems rely on extensive and complex cooling networks that incorporate both dry coolers and chillers. Designing these systems is very challenging because many parameters interact in nonlinear ways, and simulation-based optimization requires significant computational resources. This paper presents a machine learning framework incorporating physics-based constraints for the efficient optimization of parametric cooling systems. The framework includes three main stages: data exploration, modeling, and optimization. In the first stage, simulation data are analyzed to extract key parameters such as Cooling Efficiency, Power Consumption, Cooling Power, Chiller Capacity, Water Inlet Temperature, etc. The modeling stage uses machine learning models to predict a composite performance score that combines cooling effectiveness, energy efficiency, and CO2 savings. Finally, a physics-constrained optimization algorithm (L-BFGS-B: Limited-memory Broyden–Fletcher–Goldfarb–Shanno with Bounds) finds the best parameter combinations while ensuring physical consistency in energy balance, temperature limits, and COP values. The results show that the proposed AI model can accurately predict system performance and identify optimal configurations. For 20 system configurations, the model achieved an R2 of 0.93, showing strong predictive capability. Key influential factors include Fan Power, Cooling Efficiency, COP (Chiller) and Power Consumption. This approach has the potential to provide a accurate and reliable alternative to full-scale simulations.

Place, publisher, year, edition, pages
INSTICC, 2026
Series
International Conference on Agents and Artificial Intelligence, ISSN 2184-3589
Keywords
Cooling Optimization, HVDC Systems, Machine Learning, Physics-Constrained Modeling, Thermal Management
National Category
Energy Engineering
Identifiers
urn:nbn:se:mdh:diva-78174 (URN)10.5220/0014453600004052 (DOI)2-s2.0-105041756945 (Scopus ID)9789897587962 (ISBN)
Conference
18th International Conference on Agents and Artificial Intelligence, ICAART 2026, Marbella, Spain, 5-8 March, 2026
Available from: 2026-06-24 Created: 2026-06-24 Last updated: 2026-06-24Bibliographically approved
Ahmed, M. U., Barua, S., Islam, M. R., D'Cruze, R. S., Begum, S., Kebir, S., . . . Hurter, C. (2025). A Multimodal Approach for Enhancing Decision Support in Remote Digital Tower. In: 2025 10th International Conference on Machine Learning Technologies (ICMLT): . Paper presented at 10th International Conference on Machine Learning Technologies (ICMLT) 23-25 May 2025 (pp. 69-76). Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>A Multimodal Approach for Enhancing Decision Support in Remote Digital Tower
Show others...
2025 (English)In: 2025 10th International Conference on Machine Learning Technologies (ICMLT), Institute of Electrical and Electronics Engineers (IEEE) , 2025, p. 69-76Conference paper, Published paper (Refereed)
Abstract [en]

Trustworthy decision support systems utilizing a multimodal approach (MMA) integrate diverse data modalities to enhance robustness, transparency, and fairness in artificial intelligence (AI) applications. In this study, we present an MMA for decision support in the Air Traffic Management (ATM) domain, particularly within Remote Digital Towers (RDTs). RDTs replace traditional control towers with AI-driven digital solutions, enhancing operational efficiency. Our approach addresses key multimodal challenges—translation, alignment, and co-learning—by implementing (a) an open-vocabulary-based object detection model for video processing and (b) an audio-to-text transcription and semantic word identification model. The YOLO-World deep-learning model is employed for object detection, while audio data analysis takes advantage of a benchmark data set, semantic identification techniques, and explainability. Additionally, the system integrates robust machine learning techniques, including data augmentation and perturbation, to maintain consistent performance across varied operational conditions. This proof-of-concept demonstrates the potential of multimodal AI systems to enhance decision support and improve safety in ATM environments.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:mdh:diva-74513 (URN)10.1109/icmlt65785.2025.11193403 (DOI)001775741000011 ()2-s2.0-105022259028 (Scopus ID)979-8-3315-3672-5 (ISBN)
Conference
10th International Conference on Machine Learning Technologies (ICMLT) 23-25 May 2025
Available from: 2025-11-25 Created: 2025-11-25 Last updated: 2026-07-15Bibliographically approved
Begum, S., Barua, S., Ahmed, M. U. & Islam, M. R. (2025). A Theoretical Probabilistic Framework for Explaining Generative AI. In: 2025 International Conference on Advanced Machine Learning and Data Science (AMLDS): . Paper presented at 2025 International Conference on Advanced Machine Learning and Data Science (AMLDS) (pp. 37-45). Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>A Theoretical Probabilistic Framework for Explaining Generative AI
2025 (English)In: 2025 International Conference on Advanced Machine Learning and Data Science (AMLDS), Institute of Electrical and Electronics Engineers (IEEE) , 2025, p. 37-45Conference paper, Published paper (Refereed)
Abstract [en]

This study uses Generative Artificial Intelligence (gAI) to advance industrial digitization. Although the use of gAI looks promising for industrial digitization, there are significant gaps in current Explainable Artificial Intelligence (XAI) methods, which limit their applicability to such applications. By developing a theoretical framework, the aim is to provide explanations for gAI to improve decision-making processes with actionable insights and explanations for their intended outcomes. The proposed work has an impact on facilitating inspection, monitoring, optimization, and maintenance of industrial equipment and machinery. The theoretical framework proposed in this paper will address this challenge by following a three-step approach: 1) learning prior and posterior from data, 2) feature attribution and counterfactual explanation-based methods, and 3) integrated XAI. While the current study is theoretical, future work will focus on applying the approach to real-world industrial scenarios.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Generative Artificial Intelligence, gAI, Explainable Artificial Intelligence, XAI, Theoretical Framework, Probabilistic Approach.
National Category
Computer and Information Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-73701 (URN)10.1109/AMLDS63918.2025.11159340 (DOI)2-s2.0-105019050431 (Scopus ID)9798331510992 (ISBN)
Conference
2025 International Conference on Advanced Machine Learning and Data Science (AMLDS)
Funder
Swedish Research Council, 2024-05613Vinnova, 2024-01402EU, Horizon Europe, 101114838Vinnova, 2021-03679
Available from: 2025-10-12 Created: 2025-10-12 Last updated: 2026-02-13Bibliographically approved
Hossain Bhuiyan, M. M., Barua, S., Ahmed, M. U. & Begum, S. (2025). An End-to-End Explainable Fault Prediction Pipeline for Embedded Test Systems. In: 2025 28th International Conference on Computer and Information Technology (ICCIT): . Paper presented at 2025 28th International Conference on Computer and Information Technology (ICCIT), 19-21 December 2025, Cox's Bazar, Bangladesh (pp. 2944-2949). Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>An End-to-End Explainable Fault Prediction Pipeline for Embedded Test Systems
2025 (English)In: 2025 28th International Conference on Computer and Information Technology (ICCIT), Institute of Electrical and Electronics Engineers (IEEE) , 2025, p. 2944-2949Conference paper, Published paper (Refereed)
Abstract [en]

This work presents an explainable AI framework for fault predictions of Embedded Test Systems, combining classification and trend prediction. Random Forest (RF) and Gradient Boosting (GB) are used as baselines for classification, and the pipeline is extended with sliding-window sequence modelling using LSTM. With the data set, RF achieved 99.84% accuracy and 1.00 ROC-AUC, while Gradient Boosting achieved 98.59% accuracy and 0.96 ROC-AUC. The LSTM forecasts nexttimestep measurement and supports control-chart monitoring, yielding low errors for passed instances (MAE ≈0.007; RMSE ≈0.008) and higher errors for failed ones (MAE ≈1.158; RMSE ≈1.454), effectively flagging unstable behaviour. To enhance interpretability, SHAP and LIME explanations are computed and deployed in a Django-based web application for uploading data, prediction, and visualisation. Additionally, a lightweight Large Language Model (LLM) generates natural language rationales, helping engineers understand which features and time segments drive each decision. Results confirm that tree-based models provide robust baselines, while sequence-aware modelling and explainable AI add practical value for monitoring signals in production.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Series
International Conference on Computer and Information Technology (ICCIT), ISSN 2474-9656, E-ISSN 2474-9648
Keywords
Embedded Test Systems, PCBA, fault prediction, Random Forest, Gradient Boosting, LSTM, windowing, SHAP, LIME, explainability, Django, large language model
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-77629 (URN)10.1109/iccit68739.2025.11490219 (DOI)2-s2.0-105041634554 (Scopus ID)979-8-3315-7867-1 (ISBN)979-8-3315-7868-8 (ISBN)
Conference
2025 28th International Conference on Computer and Information Technology (ICCIT), 19-21 December 2025, Cox's Bazar, Bangladesh
Available from: 2026-06-12 Created: 2026-06-12 Last updated: 2026-06-29Bibliographically approved
Islam, M. R., Begum, S., Ahmed, M. U. & Barua, S. (2025). Attention-based fuzzy neural networks for self-supervised data annotation. Intelligent Systems with Applications, 28, Article ID 200610.
Open this publication in new window or tab >>Attention-based fuzzy neural networks for self-supervised data annotation
2025 (English)In: Intelligent Systems with Applications, ISSN 2667-3053, Vol. 28, article id 200610Article in journal (Refereed) Published
Abstract [en]

Annotating vibration data from heavy-duty pumps in the mining industry is highly challenging because it demands domain knowledge, a complex inspection setup, and, in many cases, remains infeasible. A self-supervised data annotation (SSDA) framework is therefore proposed and evaluated on historical data of slurry-pump vibration signals. The framework began with the collection of heterogeneous information, followed by information fusion using an autoencoder. This was then followed by a datafication step for preprocessing and achieving a better representation of features through a feature embedding technique. As a result, redundant information was pushed into an eight-dimensional latent space, achieving a reconstruction loss of 0.0023. Furthermore, Initial data annotation was obtained by combining the Isolation Forest and Kneedle algorithms to locate a data-driven knee or threshold, and it was found to be 0.58 for predicting labels. Partial samples were labeled and considered accurate. Lastly, an attention-based fuzzy neural network (AFNN) is trained on those labels where membership functions convert each latent feature into graded truth values. At the same time, an attention layer highlights the most relevant rules. An iterative self-training loop was implemented to refine the training set and obtain labeled data with higher model confidence. Here, we also tested six baseline models and found AFNN quite impressive. After seven iterations 2780 of 2872 samples were labeled and the remaining 92 are considered uncertain, still need some review from an expert, and the AFNN model confidence was (96.8%). Statistical analysis confirmed that the model predictions were significantly associated with true labels (p<0.05) and not driven by chance. 

Place, publisher, year, edition, pages
Elsevier BV, 2025
Keywords
Attention mechanism, Data annotation, Fuzzy neural network, Industry 4.0, Self supervised learning, Data mining, Fuzzy inference, Information fusion, Labeled data, Learning systems, Membership functions, Self-supervised learning, Supervised learning, Attention mechanisms, Domain knowledge, Fuzzy-neural-networks, Heavy duty pumps, Historical data, Pump vibrations, Slurry pumps, Vibration data, Vibration signal, Fuzzy neural networks
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:mdh:diva-74558 (URN)10.1016/j.iswa.2025.200610 (DOI)001619792800001 ()2-s2.0-105021619864 (Scopus ID)
Available from: 2025-11-26 Created: 2025-11-26 Last updated: 2026-03-23Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-7305-7169

Search in DiVA

Show all publications