https://www.mdu.se/

mdu.sePublications
Change search
Link to record
Permanent link

Direct link
Publications (10 of 134) Show all publications
Ahmed, M. U., Hurter, C., Barua, S., Begum, S., Arico, P., Baranzini, D. & Cavagnetto, N. (2026). Bias-Aware Generative XAI for Sustainable Air Traffic Control: A Methodological Framework with Predictive Telemetry. In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies: . Paper presented at 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia (pp. 6-13). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Bias-Aware Generative XAI for Sustainable Air Traffic Control: A Methodological Framework with Predictive Telemetry
Show others...
2026 (English)In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, Association for Computing Machinery (ACM) , 2026, p. 6-13Conference paper, Published paper (Refereed)
Abstract [en]

Artificial Intelligence (AI) is reshaping decision-making across industries, but in life-critical domains like Air Traffic Control (ATC), performance alone is not enough - AI must also be transparent, accountable, and human-centered. At the same time, ecological sustainability (e.g., fuel efficiency, emissions reduction, noise abatement) is becoming a key operational priority. Yet under high workload or time pressure, these goals are often deprioritized. This paper introduces a novel framework for bias-aware human-AI teaming in ATC, integrating Generative Explainable AI (genXAI), Predictive Telemetry (PT), multimodal machine learning, and mechanistic interpretability. Designed for Air Traffic Controllers (ATCOs), the system anticipates future traffic states, detects bias-prone conditions, and delivers adaptive, context-sensitive explanations. Through bias-aware interfaces, serious-game training, and neuroadaptive feedback loops, the framework aligns decision support with cognitive state and operational complexity. The framework targets three key objectives: (1) mitigating cognitive biases, (2) improving ground routing decisions, and (3) validating anticipatory AI models. By reframing sustainability as a human-AI collaboration challenge, this work advances a new class of trustworthy, bias-aware AI that enhances both safety and ecological performance in Air Traffic Management (ATM). 

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2026
Keywords
Air Traffic Controllers, Air Traffic Management, Artificial Intelligence, Cognitive bias modelling, Generative Explainable AI, Mechanistic Interpretability, Multimodal Machine Learning, Predictive Telemetry, Advanced traffic management systems, Air navigation, Air transportation, Behavioral research, Cognitive systems, Computer aided software engineering, Decision making, Decision support systems, Digital avionics, Emission control, Interactive computer systems, Learning systems, Machine learning, Noise abatement, Telemetering, Air traffic controller, Bias modeling, Cognitive bias, Cognitive bias modeling, Generative explainable artificial intelligence, Interpretability, Machine-learning, Mechanistics, Multi-modal, Air traffic control
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-77531 (URN)10.1145/3795496.3795708 (DOI)2-s2.0-105037586298 (Scopus ID)9798400721526 (ISBN)
Conference
2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia
Available from: 2026-06-11 Created: 2026-06-11 Last updated: 2026-06-11Bibliographically approved
Salwa Rabbi Nishat, T., Barua, S., Ahmed, M. U. & Begum, S. (2026). Enhancing Random Forest Using Genetic Algorithm for Lifelong Machine Learning. IEEE Access, 14, 6310-6325
Open this publication in new window or tab >>Enhancing Random Forest Using Genetic Algorithm for Lifelong Machine Learning
2026 (English)In: IEEE Access, E-ISSN 2169-3536, Vol. 14, p. 6310-6325Article in journal (Refereed) Published
Abstract [en]

Learning over time for machine learning (ML) models is emerging as a new field, often called continual learning or lifelong Machine learning (LML). Today, deep learning and neural networks are the prevalent approaches for LML models. However, they are often criticized for being “black box” methods, and catastrophic forgetting has remained a persistent challenge throughout their development. This paradigm represents a significant shift from traditional static learning models, enabling systems to adapt to new data continuously while retaining previously acquired knowledge. In this paper, an LML approach is proposed that combines a Random Forest (RF) with a Genetic Algorithm (GA) to transfer the knowledge from an existing RF model to a new learning model. Here, the GA is applied to the RF model so that the weights of this model get balanced more steadily. The approach is evaluated here for classification problems on three benchmark datasets. The initial results present knowledge retention in the new model, indicating the success of the model. These methods are regularization-based and effective in mitigating catastrophic forgetting. However, they rely on Fisher Information to estimate parameter importance or similar measures, which are computationally demanding and suitable for deep neural networks. While many NN-based lifelong learning approaches have been studied, RFs remain comparatively underexplored in this paradigm. Given their robustness, interpretability, and effectiveness in tabular datasets with limited samples, RFs present a compelling alternative. This motivates our work on developing an RF-based lifelong learning approach. 

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2026
Keywords
genetic algorithm, lifelong learning, Lifelong machine learning, random forest
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-75632 (URN)10.1109/ACCESS.2026.3651601 (DOI)001663376800011 ()2-s2.0-105027662643 (Scopus ID)
Available from: 2026-01-28 Created: 2026-01-28 Last updated: 2026-06-12Bibliographically approved
Cartocci, G., Veyrié, A., Cavagnetto, N., Hurter, C., Degas, A., Ferreira, A., . . . Aricò, P. (2026). Explainable artificial intelligence in air traffic control: effects of expertise on workload, acceptance, and usage intentions. Brain Informatics
Open this publication in new window or tab >>Explainable artificial intelligence in air traffic control: effects of expertise on workload, acceptance, and usage intentions
Show others...
2026 (English)In: Brain Informatics, ISSN 2198-4018, E-ISSN 2198-4026Article in journal (Refereed) Published
Abstract [en]

Explainability is crucial for establishing user trust in Artificial Intelligence (AI), particularly within safety-critical domains such as Air Traffic Management (ATM) and Air Traffic Control (ATC). This study empirically investigates the effects of Explainable AI (XAI), specifically HeatMap-based visual explanations, on cognitive workload, user acceptance, and intention to use AI-driven decision-support systems among Air Traffic Control Officers (ATCOs). Despite significant theoretical advancements in the broader XAI domain, empirical evidence addressing the specific impact of visual explanations on human-AI interactions in safety-critical environments like ATC remains limited. To address these critical gaps, an experimental comparison was conducted between explainable (HeatMap) and non-explainable (BlackBox) AI conditions, involving two user groups: expert and student ATCOs. Both objective neurophysiological measures (Electroencephalography) and subjective questionnaires were employed to capture comprehensive user responses. Key findings revealed that the presence of visual explanations significantly reduced cognitive workload and enhanced users' willingness to adopt the AI system, regardless of participants' level of expertise. However, explicit perceptions of AI's impact on work performance were predominantly influenced by expertise, with less experienced controllers reporting a greater perceived impact than their expert counterparts. By combining objective neurometrics with subjective user assessments, this research advances methodological rigor in evaluating human-AI interactions and highlights the importance of tailored, user-centric explanations. These findings directly contribute to practical guidelines for designing cognitively compatible and trustworthy AI tools in ATC, providing nuanced insights for targeted training and deployment strategies based on user expertise. 

Place, publisher, year, edition, pages
Springer Nature, 2026
Keywords
Air traffic control, Electroencephalography, Expertise, Explainable artificial intelligence, Workload
National Category
Computer Systems
Identifiers
urn:nbn:se:mdh:diva-75793 (URN)10.1186/s40708-025-00287-6 (DOI)001712162500001 ()41579282 (PubMedID)2-s2.0-105033819242 (Scopus ID)
Funder
Mälardalen UniversityMälardalen University
Available from: 2026-02-06 Created: 2026-02-06 Last updated: 2026-07-02Bibliographically approved
Islam, M. R., Begum, S., Ahmed, M. U., Darbhamalla, S. T., Sundström, T. & Spetz, G. (2026). Explainable Multi-Stage Self-Supervised Learning Framework for Intelligent Fault Diagnosis. In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies: . Paper presented at 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia (pp. 25-35). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Explainable Multi-Stage Self-Supervised Learning Framework for Intelligent Fault Diagnosis
Show others...
2026 (English)In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, Association for Computing Machinery (ACM) , 2026, p. 25-35Conference paper, Published paper (Refereed)
Abstract [en]

Fault detection and diagnosis in complex industrial systems, such as slurry pumps used in mining, is impractical with lack of labeled data. However, most of the existing studies rely on labelled data and the black-box nature of machine learning or deep learning approaches. While some studies have focused on model-specific explanations, domain-specific explanations are still missing, which hinders actionable maintenance decisions. To address those challenges, this study focuses on an explainable multi-stage self-supervised learning framework for intelligent fault discovery and diagnosis with three sequential phases: (1) a self-supervised module that generates high-confidence labels by fusing vibration sensor and process data through autoencoders, Isolation Forest, and Gaussian Mixture Models with cross-modality consensus, (2) a supervised classification phase enhanced with SHAP-based explainability to distinguish between healthy and anomalous operation with high accuracy, and (3) a fault confirmation and diagnosis layer that categorizes severity (Tolerable, Moderate, Severe) and identifies likely fault types using domain knowledge and shallow decision trees. An experimental study evaluated on real-world slurry pump data demonstrates that the framework successfully generated 19,369 healthy and 654 anomalous training labeled samples. The supervised models achieved exceptional performance, with 99.9% accuracy and perfect recall (100%) in distinguishing healthy from anomalous states. The severity categorization identified 58.6% cases as tolerable (potentially edge-case operations), 27.8% as severe, and 13.6% as moderate, while fault type identification revealed cavitation or impeller damage as the most prevalent fault (46%). This approach bridges data-driven learning and expert knowledge, enabling trustworthy, explainable, and actionable fault discovery and diagnosis in safety-critical industrial environments.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2026
Keywords
Explainable AI (XAI), Industrial fault diagnosis, Predictive maintenance, Rule-based reasoning, Self-supervised learning, Data mining, Deep learning, Failure analysis, Fault detection, Labeled data, Learning algorithms, Learning systems, Safety engineering, Supervised learning, Faults diagnosis, Industrial fault diagnose, Intelligent fault diagnosis, Learning frameworks, Multi-stages, Slurry pumps, Decision trees
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-77543 (URN)10.1145/3795496.3795710 (DOI)2-s2.0-105037615361 (Scopus ID)9798400721526 (ISBN)
Conference
2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia
Available from: 2026-06-11 Created: 2026-06-11 Last updated: 2026-06-11Bibliographically approved
Shkarpa, A., Barua, S., Begum, S. & Ahmed, M. U. (2026). Hybrid Neuro-Fuzzy Approach for Transparent Anomaly Detection in Mining Equipment. In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies: . Paper presented at 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia (pp. 36-43). Association for Computing Machinery (ACM)
Open this publication in new window or tab >>Hybrid Neuro-Fuzzy Approach for Transparent Anomaly Detection in Mining Equipment
2026 (English)In: Proceedings of AIACT 2026 - 2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, Association for Computing Machinery (ACM) , 2026, p. 36-43Conference paper, Published paper (Refereed)
Abstract [en]

Predictive maintenance is critical for minimizing downtime and operational costs in mining industries, where slurry pumps operate under abrasive and highly variable conditions. Traditional machine learning models, while accurate, often lack interpretability, limiting their adoption in safety-critical environments. This paper presents an Adaptive Neuro-Fuzzy Inference System (ANFIS) based approach for anomaly detection in slurry pumps using vibration-based features such as displacement, velocity, crest factor, kurtosis, skewness, peak, and peak-to-peak values. ANFIS combines the transparency of fuzzy logic with the learning capability of neural networks, enabling interpretable IF-THEN rules and adaptive tuning of membership functions. A dataset of 33,104 vibration samples was analyzed under four balancing strategies to address class imbalance. Models were evaluated using accuracy, precision, recall, F1-score, RMSE, and clustering quality metrics (Dunn Index and Silhouette Score). The results demonstrate that ANFIS achieves high accuracy (>99%) and strong interpretability, outperforming traditional black-box models. The proposed approach enhances trustworthiness and adaptability in predictive maintenance systems, offering an explainable solution for Industry 4.0 applications. Future work will explore hybrid models, real-time IoT integration, and edge deployment for dynamic operational environments.

Place, publisher, year, edition, pages
Association for Computing Machinery (ACM), 2026
Keywords
Adaptive Neuro-Fuzzy Inference System (ANFIS), Anomaly Detection, Condition Monitoring, Explainable AI, Industry 4.0, Mining Industry, Predictive Maintenance, Vibration Analysis, Balancing, Data mining, Fuzzy inference, Fuzzy neural networks, Fuzzy systems, Higher order statistics, Learning systems, Membership functions, Adaptive neuro-fuzzy inference, Adaptive neuro-fuzzy inference system, Condition, Interpretability, Neuro-fuzzy inference systems, Slurry pumps, Vibrations analysis
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-77532 (URN)10.1145/3795496.3795711 (DOI)2-s2.0-105037604766 (Scopus ID)9798400721526 (ISBN)
Conference
2026 10th International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2026, 2-6 February, 2026, Sydney, Australia
Available from: 2026-06-11 Created: 2026-06-11 Last updated: 2026-06-11Bibliographically approved
Barua, A., Ahmed, M. U. & Begum, S. (2026). Mechanistic Interpretability of ReLU Neural Networks Through Piecewise-Affine Mapping. Machine Learning, 115(1), Article ID 17.
Open this publication in new window or tab >>Mechanistic Interpretability of ReLU Neural Networks Through Piecewise-Affine Mapping
2026 (English)In: Machine Learning, ISSN 0885-6125, E-ISSN 1573-0565, Vol. 115, no 1, article id 17Article in journal (Refereed) Published
Abstract [en]

Rectified linear unit (ReLU) based neural networks (NNs) are recognised for their remarkable accuracy. However, the decision-making processes of these networks are often complex and difficult to understand. This complexity can lead to challenges in error identification, establishing trust, and conducting thorough analyses. Existing methods often fail to provide clear insights into the actual computations occurring within each layer of these networks. To address this challenge, this study introduces a mechanistic interpretability method called ReLU Region Reasoning (Re3). This method uses the known piecewise-linear characteristics of ReLU networks to offer insights into neuron activation and accurately assess how each feature contributes to the final output and probability. Re3 effectively determines neuron activations and evaluates the contribution of each feature within a specified linear region. Experiments conducted on multiple benchmark datasets, including both tabular and image data, demonstrate that Re3 can replicate individual predictions without error, align feature importance with domain expertise, and maintain consistency with current explanatory methods, thereby avoiding the typical randomness. Analysing neurons reveals activation sparsity and identifies dominant units, thus providing clear targets for model simplification and troubleshooting. By ensuring transparency and algebraic accessibility in each stage of a ReLU-based NN's decision process, Re3 can be a valuable practical tool for achieving precise mechanistic interpretability.

Place, publisher, year, edition, pages
Springer Nature, 2026
Keywords
Neural networks, Rectified linear unit, Reasoning, Interpretability
National Category
Computer Sciences
Identifiers
urn:nbn:se:mdh:diva-75497 (URN)10.1007/s10994-025-06957-0 (DOI)001656690800001 ()2-s2.0-105027259375 (Scopus ID)
Available from: 2026-01-21 Created: 2026-01-21 Last updated: 2026-01-21Bibliographically approved
Kabir, M. M., Barua, S., Ahmed, M. U., Nourozi, B., Begum, S. & Bel Fdhila, R. (2026). Physics-Constrained Machine Learning Framework for Parametric Optimization of Industrial Cooling Systems. In: International Conference on Agents and Artificial Intelligence: . Paper presented at 18th International Conference on Agents and Artificial Intelligence, ICAART 2026, Marbella, Spain, 5-8 March, 2026 (pp. 3526-3537). INSTICC
Open this publication in new window or tab >>Physics-Constrained Machine Learning Framework for Parametric Optimization of Industrial Cooling Systems
Show others...
2026 (English)In: International Conference on Agents and Artificial Intelligence, INSTICC , 2026, p. 3526-3537Conference paper, Published paper (Refereed)
Abstract [en]

High-voltage direct current (HVDC) systems rely on extensive and complex cooling networks that incorporate both dry coolers and chillers. Designing these systems is very challenging because many parameters interact in nonlinear ways, and simulation-based optimization requires significant computational resources. This paper presents a machine learning framework incorporating physics-based constraints for the efficient optimization of parametric cooling systems. The framework includes three main stages: data exploration, modeling, and optimization. In the first stage, simulation data are analyzed to extract key parameters such as Cooling Efficiency, Power Consumption, Cooling Power, Chiller Capacity, Water Inlet Temperature, etc. The modeling stage uses machine learning models to predict a composite performance score that combines cooling effectiveness, energy efficiency, and CO2 savings. Finally, a physics-constrained optimization algorithm (L-BFGS-B: Limited-memory Broyden–Fletcher–Goldfarb–Shanno with Bounds) finds the best parameter combinations while ensuring physical consistency in energy balance, temperature limits, and COP values. The results show that the proposed AI model can accurately predict system performance and identify optimal configurations. For 20 system configurations, the model achieved an R2 of 0.93, showing strong predictive capability. Key influential factors include Fan Power, Cooling Efficiency, COP (Chiller) and Power Consumption. This approach has the potential to provide a accurate and reliable alternative to full-scale simulations.

Place, publisher, year, edition, pages
INSTICC, 2026
Series
International Conference on Agents and Artificial Intelligence, ISSN 2184-3589
Keywords
Cooling Optimization, HVDC Systems, Machine Learning, Physics-Constrained Modeling, Thermal Management
National Category
Energy Engineering
Identifiers
urn:nbn:se:mdh:diva-78174 (URN)10.5220/0014453600004052 (DOI)2-s2.0-105041756945 (Scopus ID)9789897587962 (ISBN)
Conference
18th International Conference on Agents and Artificial Intelligence, ICAART 2026, Marbella, Spain, 5-8 March, 2026
Available from: 2026-06-24 Created: 2026-06-24 Last updated: 2026-06-24Bibliographically approved
Ahmed, M. U., Barua, S., Islam, M. R., D'Cruze, R. S., Begum, S., Kebir, S., . . . Hurter, C. (2025). A Multimodal Approach for Enhancing Decision Support in Remote Digital Tower. In: 2025 10th International Conference on Machine Learning Technologies (ICMLT): . Paper presented at 10th International Conference on Machine Learning Technologies (ICMLT) 23-25 May 2025 (pp. 69-76). Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>A Multimodal Approach for Enhancing Decision Support in Remote Digital Tower
Show others...
2025 (English)In: 2025 10th International Conference on Machine Learning Technologies (ICMLT), Institute of Electrical and Electronics Engineers (IEEE) , 2025, p. 69-76Conference paper, Published paper (Refereed)
Abstract [en]

Trustworthy decision support systems utilizing a multimodal approach (MMA) integrate diverse data modalities to enhance robustness, transparency, and fairness in artificial intelligence (AI) applications. In this study, we present an MMA for decision support in the Air Traffic Management (ATM) domain, particularly within Remote Digital Towers (RDTs). RDTs replace traditional control towers with AI-driven digital solutions, enhancing operational efficiency. Our approach addresses key multimodal challenges—translation, alignment, and co-learning—by implementing (a) an open-vocabulary-based object detection model for video processing and (b) an audio-to-text transcription and semantic word identification model. The YOLO-World deep-learning model is employed for object detection, while audio data analysis takes advantage of a benchmark data set, semantic identification techniques, and explainability. Additionally, the system integrates robust machine learning techniques, including data augmentation and perturbation, to maintain consistent performance across varied operational conditions. This proof-of-concept demonstrates the potential of multimodal AI systems to enhance decision support and improve safety in ATM environments.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
National Category
Computer and Information Sciences
Identifiers
urn:nbn:se:mdh:diva-74513 (URN)10.1109/icmlt65785.2025.11193403 (DOI)2-s2.0-105022259028 (Scopus ID)979-8-3315-3672-5 (ISBN)
Conference
10th International Conference on Machine Learning Technologies (ICMLT) 23-25 May 2025
Available from: 2025-11-25 Created: 2025-11-25 Last updated: 2025-12-03Bibliographically approved
Begum, S., Barua, S., Ahmed, M. U. & Islam, M. R. (2025). A Theoretical Probabilistic Framework for Explaining Generative AI. In: 2025 International Conference on Advanced Machine Learning and Data Science (AMLDS): . Paper presented at 2025 International Conference on Advanced Machine Learning and Data Science (AMLDS) (pp. 37-45). Institute of Electrical and Electronics Engineers (IEEE)
Open this publication in new window or tab >>A Theoretical Probabilistic Framework for Explaining Generative AI
2025 (English)In: 2025 International Conference on Advanced Machine Learning and Data Science (AMLDS), Institute of Electrical and Electronics Engineers (IEEE) , 2025, p. 37-45Conference paper, Published paper (Refereed)
Abstract [en]

This study uses Generative Artificial Intelligence (gAI) to advance industrial digitization. Although the use of gAI looks promising for industrial digitization, there are significant gaps in current Explainable Artificial Intelligence (XAI) methods, which limit their applicability to such applications. By developing a theoretical framework, the aim is to provide explanations for gAI to improve decision-making processes with actionable insights and explanations for their intended outcomes. The proposed work has an impact on facilitating inspection, monitoring, optimization, and maintenance of industrial equipment and machinery. The theoretical framework proposed in this paper will address this challenge by following a three-step approach: 1) learning prior and posterior from data, 2) feature attribution and counterfactual explanation-based methods, and 3) integrated XAI. While the current study is theoretical, future work will focus on applying the approach to real-world industrial scenarios.

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers (IEEE), 2025
Keywords
Generative Artificial Intelligence, gAI, Explainable Artificial Intelligence, XAI, Theoretical Framework, Probabilistic Approach.
National Category
Computer and Information Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-73701 (URN)10.1109/AMLDS63918.2025.11159340 (DOI)2-s2.0-105019050431 (Scopus ID)9798331510992 (ISBN)
Conference
2025 International Conference on Advanced Machine Learning and Data Science (AMLDS)
Funder
Swedish Research Council, 2024-05613Vinnova, 2024-01402EU, Horizon Europe, 101114838Vinnova, 2021-03679
Available from: 2025-10-12 Created: 2025-10-12 Last updated: 2026-02-13Bibliographically approved
Barua, A. (2025). Advanced Hybrid Reasoning and Transfer Learning on Multimodal Data with Transformers. Springer Nature Computer Science, 6(3)
Open this publication in new window or tab >>Advanced Hybrid Reasoning and Transfer Learning on Multimodal Data with Transformers
2025 (English)In: Springer Nature Computer Science, ISSN 2662995X, Vol. 6, no 3Article in journal (Refereed) Published
Abstract [en]

Reasoning is a vital process in machine learning (ML), involving making inferences and drawing conclusions based on data. This capability is important for developing intelligent systems which can understand and predict complex patterns. The study investigates reasoning through two distinct methodologies: multimodal reasoning and transfer learning based reasoning. In the first approach, multimodal reasoning is used with a semi-supervised method to label unlabelled datasets. In the second approach, transfer learning has been used to transfer knowledge of data from one model to another. Both approaches are demonstrated using unlabelled vehicular telemetry data. During processing, three sets of telemetry data are used to extract features separately through the autoencoder. These features are then clustered and aligned to create labelled and unlabelled datasets. The eXtreme Gradient Boosting (XGBoost) algorithm achieved over 98% test accuracy when applied to the labelled datasets and was then used to predict labels for the unlabelled datasets, which were later added to the labelled dataset to form three datasets for further processing. In transfer learning, a transformer model specifically designed to handle continuous features is developed. Labelled datasets are applied to the transformer model, one after the other, resulting in three final models, with each model achieving over 80% accuracy. The model’s prediction confidence is also validated using conformal learning, where the final models achieved over 80% accuracy. The transformer model is also separately trained on the datasets and compared with traditional ML models, outperforming the others by achieving an accuracy of 98%. By building on the groundwork laid by this study, future research can push the boundaries of what is possible with reasoning approaches, opening up new paths for scientific exploration and practical applications in different fields.

Place, publisher, year, edition, pages
Springer Nature, 2025
Keywords
Multimodal reasoning, Semi-supervised learning, Supervised alignment, Transfer learning, Transformer
National Category
Computer and Information Sciences Computer Sciences
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-69147 (URN)10.1007/s42979-025-03706-x (DOI)2-s2.0-85218692188 (Scopus ID)
Funder
EU, Horizon 2020, 953432
Available from: 2024-11-15 Created: 2024-11-15 Last updated: 2026-06-12Bibliographically approved
Organisations
Identifiers
ORCID iD: ORCID iD iconorcid.org/0000-0002-1212-7637

Search in DiVA

Show all publications