https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Attention-based fuzzy neural networks for self-supervised data annotation
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0003-0904-9268
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0002-1212-7637
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0003-3802-4721
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0002-7305-7169
2025 (English)In: Intelligent Systems with Applications, ISSN 2667-3053, Vol. 28, article id 200610Article in journal (Refereed) Published
Abstract [en]

Annotating vibration data from heavy-duty pumps in the mining industry is highly challenging because it demands domain knowledge, a complex inspection setup, and, in many cases, remains infeasible. A self-supervised data annotation (SSDA) framework is therefore proposed and evaluated on historical data of slurry-pump vibration signals. The framework began with the collection of heterogeneous information, followed by information fusion using an autoencoder. This was then followed by a datafication step for preprocessing and achieving a better representation of features through a feature embedding technique. As a result, redundant information was pushed into an eight-dimensional latent space, achieving a reconstruction loss of 0.0023. Furthermore, Initial data annotation was obtained by combining the Isolation Forest and Kneedle algorithms to locate a data-driven knee or threshold, and it was found to be 0.58 for predicting labels. Partial samples were labeled and considered accurate. Lastly, an attention-based fuzzy neural network (AFNN) is trained on those labels where membership functions convert each latent feature into graded truth values. At the same time, an attention layer highlights the most relevant rules. An iterative self-training loop was implemented to refine the training set and obtain labeled data with higher model confidence. Here, we also tested six baseline models and found AFNN quite impressive. After seven iterations 2780 of 2872 samples were labeled and the remaining 92 are considered uncertain, still need some review from an expert, and the AFNN model confidence was (96.8%). Statistical analysis confirmed that the model predictions were significantly associated with true labels (p<0.05) and not driven by chance. 

Place, publisher, year, edition, pages
Elsevier BV , 2025. Vol. 28, article id 200610
Keywords [en]
Attention mechanism, Data annotation, Fuzzy neural network, Industry 4.0, Self supervised learning, Data mining, Fuzzy inference, Information fusion, Labeled data, Learning systems, Membership functions, Self-supervised learning, Supervised learning, Attention mechanisms, Domain knowledge, Fuzzy-neural-networks, Heavy duty pumps, Historical data, Pump vibrations, Slurry pumps, Vibration data, Vibration signal, Fuzzy neural networks
National Category
Computer and Information Sciences
Identifiers
URN: urn:nbn:se:mdh:diva-74558DOI: 10.1016/j.iswa.2025.200610ISI: 001619792800001Scopus ID: 2-s2.0-105021619864OAI: oai:DiVA.org:mdh-74558DiVA, id: diva2:2016650
Available from: 2025-11-26 Created: 2025-11-26 Last updated: 2026-03-23Bibliographically approved

Open Access in DiVA

fulltext(4770 kB)35 downloads
File information
File name FULLTEXT01.pdfFile size 4770 kBChecksum SHA-512
656756e7f1ff6db04fc32a970699ea3ce624be9f216384f424313894d562120fd6d423b193cf0cf2d6e21d709a489c4318a6a159b3e2e20e0f3d38924b863a95
Type fulltextMimetype application/pdf

Other links

Publisher's full textScopus

Authority records

Islam, Md RakibulBegum, ShahinaAhmed, Mobyen UddinBarua, Shaibal

Search in DiVA

By author/editor
Islam, Md RakibulBegum, ShahinaAhmed, Mobyen UddinBarua, Shaibal
By organisation
Embedded Systems
Computer and Information Sciences

Search outside of DiVA

GoogleGoogle Scholar
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

doi
urn-nbn

Altmetric score

doi
urn-nbn
Total: 64 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf