https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
ReqRAG: Enhancing Software Release Management through Retrieval-Augmented LLMs: An Industrial Study
Alstom, Västerås, Sweden.
Mälardalen University, School of Innovation, Design and Engineering, Innovation and Product Realisation. RISE Research Institutes of Sweden, Västerås, Sweden.
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems. RISE Research Institutes of Sweden, Västerås, Sweden.
Alstom, Västerås, Sweden.
Show others and affiliations
2025 (English)In: Lecture Notes in Computer Science, Vol. 15588, Springer Science and Business Media Deutschland GmbH , 2025, p. 277-292Conference paper, Published paper (Refereed)
Abstract [en]

[Context and Motivation] Engineers often need to refer back to release notes, manuals, and system architecture documents to understand, modify, or upgrade functionalities in alignment with new software releases. This is crucial to ensure that new stakeholder requirements align with the existing system, maintaining compatibility and preventing integration issues. [Problem] In practice, the manual process of retrieving the relevant information from technical documentation is time-intensive and frequently results in inefficient software release management. [Principal ideas/results] In this paper, we propose a question-answering chatbot, ReqRAG, leveraging Retrieval Augmented Generation (RAG) with Large Language Models (LLMs) to deliver accurate and up-to-date information from technical documents in response to given queries. We employ various context retrieval techniques paired with state-of-the-art LLMs to evaluate the ReqRAG approach in industrial settings. Furthermore, we conduct human evaluations of the results in collaboration with experts from Alstom to gain practical insights. Our results indicate that, on average, 70% of the generated responses are adequate, useful, and relevant to the practitioners. [Contribution] Fewer studies have comprehensively evaluated RAG-based approaches in industrial settings. Therefore, this work provides technical considerations for domain-specific chatbots, guiding researchers and practitioners facing similar challenges. 

Place, publisher, year, edition, pages
Springer Science and Business Media Deutschland GmbH , 2025. p. 277-292
Series
Lecture Notes in Computer Science, ISSN 0302-9743 ; 15588 LNCS
Keywords [en]
Industry Study, Large Language Models (LLMs), Retrieval Augmented Generation (RAG), Software Release Management, Information management, Online searching, Problem oriented languages, System program documentation, Chatbots, Industrial settings, Language model, Large language model, Release management, Retrieval augmented generation, Software release, Systems architecture, Search engines
National Category
Software Engineering
Identifiers
URN: urn:nbn:se:mdh:diva-71292DOI: 10.1007/978-3-031-88531-0_20ISI: 001532176400020Scopus ID: 2-s2.0-105002728440ISBN: 9783031885303 (print)OAI: oai:DiVA.org:mdh-71292DiVA, id: diva2:1955628
Conference
31st International Working Conference on Requirements Engineering: Foundation for Software Quality, REFSQ 2025, Barcelona7 April 2025 through 10 April 2025
Available from: 2025-04-30 Created: 2025-04-30 Last updated: 2025-10-10Bibliographically approved
In thesis
1. AI-augmented Requirements Engineering for Industrial Systems
Open this publication in new window or tab >>AI-augmented Requirements Engineering for Industrial Systems
2025 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

Engineering large-scale industrial systems requires an efficient Requirements Engineering (RE) process to manage the complexity resulting from continuous technological advancements. In manufacturing domains such as railways, the complexity of software-intensive systems is growing due to evolving standards, infrastructure specifications, and increasing customer expectations. Typically, the RE process begins with analyzing extensive tender documents from external customers to assess project feasibility. This analysis is critical, as the tender documents define the scope and the standards to which the system-to-be must comply. Once validated and agreed upon, the requirements are distributed among various subsystem teams for development and testing. During implementation, the evolving requirements are cross-referenced with existing technical documents to ensure consistency across project artifacts and prevent integration issues within subsystems. However, the reliance on manual efforts in performing these RE tasks makes the process labor-intensive and time-consuming, often leading to project scope creep in industrial settings.

This thesis empirically investigates Artificial Intelligence (AI), particularly Large Language Models (LLMs)-based solutions, to augment the RE process for realizing complex industrial systems. The proposed solutions aim to provide decision support to reduce the manual efforts typically required for (i) identifying requirements from other supporting information in tender documents, (ii) detecting ambiguous requirements and explaining them, (iii) allocating validated requirements to appropriate subsystem teams for development and (iv) addressing requirement-related queries during the development and release phases of the project. Consequently, this research contributes to enhancing requirements management in complex industrial systems by enabling more efficient and informed decision-making.

Abstract [sv]

Att konstruera storskaliga industriella system kräver en effektiv Requirements Engineering (RE)-process för att hantera den komplexitet som följer av kontinuerliga tekniska framsteg. Inom tillverkningsdomäner som järnväg ökar komplexiteten i mjukvaruintensiva system på grund av standarder som förändras, infrastrukturspecifikationer och ökade kundförväntningar. RE-processen inleds vanligen med att omfattande anbudsunderlag från externa beställare analyseras för att bedöma projektets genomförbarhet. Denna analys är avgörande eftersom anbudsunderlaget fastställer omfattningen och de standarder som det framtida systemet måste uppfylla. När kraven har validerats och godkänts fördelas de till olika delsystemteam för utveckling och test. Under implementeringen korsrefereras de föränderliga kraven med befintlig teknisk dokumentation för att säkerställa konsekvens emellan artefakter och förhindra integrationsproblem mellan delsystem. Det manuella arbete som krävs för dessa RE-uppgifter gör dock processen arbets- och tidskrävande, vilket ofta leder till 'scope creep' i industriella projekt.

Denna avhandling undersöker empiriskt AI-, särskilt LLMs-baserade, lösningar för att stärka RE-processen vid realisering av komplexa industriella system. De föreslagna lösningarna syftar till att ge beslutsstöd för att minska det manuella arbete som normalt krävs för (i) att identifiera krav bland övrig information i anbudsunderlag, (ii) att upptäcka tvetydiga krav och förklara dem, (iii) att fördela validerade krav till lämpliga delsystemteam för utveckling och (iv) att besvara kravsrelaterade frågor under projektets utvecklings- och releasefaser. Därmed bidrar forskningen till förbättrad kravhantering i komplexa industriella system genom att möjliggöra effektivare och mer välgrundade beslut.

Place, publisher, year, edition, pages
Västerås: Mälardalens universitet, 2025. p. 172
Series
Mälardalen University Press Licentiate Theses, ISSN 1651-9256 ; 378
National Category
Software Engineering
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-73156 (URN)978-91-7485-720-7 (ISBN)
Presentation
2025-10-16, Case, Mälardalens universitet och digitalt., Västerås, 13:15 (English)
Opponent
Supervisors
Funder
Knowledge FoundationEuropean CommissionVinnova
Available from: 2025-09-02 Created: 2025-09-01 Last updated: 2025-10-10Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Bashir, SarmadAbbas, MuhammadCicchetti, Antonio

Search in DiVA

By author/editor
Bashir, SarmadAbbas, MuhammadCicchetti, Antonio
By organisation
Innovation and Product RealisationEmbedded Systems
Software Engineering

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 227 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf