https://www.mdu.se/

mdu.sePublications
Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Black-Box Testing for Security-Informed Safety of Automated Driving Systems
Rise Research Institutes of Sweden, Borås, Sweden.
Rise Research Institutes of Sweden, Borås, Sweden.
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0002-7235-6888
Mälardalen University, School of Innovation, Design and Engineering, Embedded Systems.ORCID iD: 0000-0001-5269-3900
2021 (English)In: IEEE Vehicular Technology Conference, Institute of Electrical and Electronics Engineers Inc. , 2021, article id 9448691Conference paper, Published paper (Refereed)
Abstract [en]

An evaluation of safety and security properties performed by an independent organisation can be an important step towards establishing trust in Automated Driving Systems (ADS), bridging the gap between the marketing portrayal and the actual performance of such systems in real operating conditions. However, due to the complexity of an ADS's behaviour and dangers involved in performing real environment security attacks, we believe assessments that can be performed with a combination of simulation and validation at test facilities is the way forward.In this paper, we outline an approach to derive test suites applicable to generic ADS feature classes, where classes would have similar capabilities and comparable assessment results. The goal is to support black box testing of such feature classes as part of an independent evaluation. By the means of co-simulation of post-attack behaviour and critical scenarios, we derive a representative set of physical certification tests, to gain an understanding of the interplay between safety and security. During the initial tests an ADS is subjected to various attacks and its reactions recorded. These reactions such as reduced functionality, fall back etc., together with relevant scenarios for the class is further analysed to check for safety implications. 

Place, publisher, year, edition, pages
Institute of Electrical and Electronics Engineers Inc. , 2021. article id 9448691
Keywords [en]
Automated Driving Systems, Black-box testing, Dependability, Safety, Safety Assessment, Security, Deceleration, Safety testing, Certification tests, Real environments, Real operating conditions, Safety and securities, Security attacks, Simulation and validation, Various attacks
National Category
Embedded Systems
Identifiers
URN: urn:nbn:se:mdh:diva-55649DOI: 10.1109/VTC2021-Spring51267.2021.9448691ISI: 000687839600060Scopus ID: 2-s2.0-85112418651ISBN: 9781728189642 (print)OAI: oai:DiVA.org:mdh-55649DiVA, id: diva2:1588050
Conference
93rd IEEE Vehicular Technology Conference, VTC 2021-Spring, 25 April 2021 through 28 April 2021
Available from: 2021-08-26 Created: 2021-08-26 Last updated: 2025-12-01Bibliographically approved
In thesis
1. Towards an assessment of safety and security interplay in automated driving systems.
Open this publication in new window or tab >>Towards an assessment of safety and security interplay in automated driving systems.
2022 (English)Licentiate thesis, comprehensive summary (Other academic)
Abstract [en]

We are currently in the midst of significant changes in the road transport system, including the transformation to fossil-free propulsion and the shift to higher levels of automation. The next level in automation is soon upon us and is encompassed by the broader term Connected, Cooperative and Automated Mobility (CCAM) which is relevant for the entire transportation system. The introduction of CCAM has the potential to contribute significantly to crucial UN Sustainable Development Goals. For the automotive domain, the term Automated Driving Systems (ADS) is often used for highly automated vehicles. Notwithstanding the expected positive effects and the extraordinary efforts, highly automated driving systems are still not publicly available except in pilot programs.

The increased complexity in the higher automation levels can be ascribed to the shift from fail-safe operator support to fail-operational systems that assume the operator's role, utilising new sensors and algorithms for perception and the reliance on connectivity to solve the problem task. Here the solution is also the problem, i.e. complex systems. The complexity of the systems and difficulties in capturing a complete practical description of the environment where the systems are intended to operate pose difficulties in defining validation procedures for ADS technologies' safety, security, and trustworthiness.

Parallel to traditional safety issues, there is now a need to consider the quality of cybersecurity, e.g. due to external communication and environmental sensors being susceptible to remote attacks. A security problem may enable a hacker to incapacitate or fool an ADS resulting in unsafe behaviour. In addition to malicious misuse, the development of environment sensing has to consider functional insufficiencies of the employed sensor technologies. Therefore, both safety and security and their interplay must be addressed in developing the solutions.

The first step in gaining public confidence in the technologies involved is to raise user awareness. Therefore there is a need to be transparent and explicit on the evaluation targets and the associated supporting evidence of safe and secure ADS. An assessment of safety and security properties performed by an independent organisation can be an essential step towards establishing trust in ADS solutions, bridging the gap between the marketing portrayal and the actual performance of such systems in operating conditions.

This licentiate thesis contributes towards the overall goal of improving the assessment target and the associated supporting evidence of a safe and secure ADS in the automotive domain by (1) assessing requirements for safety, security and their interplay on key enabling technologies, (2) introducing an argument pattern enabling safety, security and interaction overlap to be jointly addressed, (3) proposing a method that enables assessment of security informed safety an independent agency.

Place, publisher, year, edition, pages
Västerås: Mälardalen University, 2022
Series
Mälardalen University Press Licentiate Theses, ISSN 1651-9256 ; 326
Keywords
Functional Safety, Cybersecurity, Automotive, Automated Drivning, Assessment
National Category
Embedded Systems
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-58110 (URN)978-91-7485-554-8 (ISBN)
Presentation
2022-06-09, Kappa, Mälardalens universitet, Västerås, 13:15 (English)
Opponent
Supervisors
Available from: 2022-05-05 Created: 2022-04-26 Last updated: 2025-10-10Bibliographically approved
2. An Integrated Framework for the Assessment of Automated Driving Systems
Open this publication in new window or tab >>An Integrated Framework for the Assessment of Automated Driving Systems
2026 (English)Doctoral thesis, comprehensive summary (Other academic)
Abstract [en]

The road transport system is undergoing major transformations, notably the transition to fossil-free propulsion and advances in automation.

In the automotive domain, highly automated vehicles are typically referred to as incorporating Automated Driving Systems (ADS). Despite significant technological progress and anticipated benefits, the widespread deployment of these systems remains limited. This slow rollout is largely due to the increased complexity at higher automation levels, where vehicles must take on the full driving task and transition to fail-operational architectures capable of managing faults without human intervention.

 

The increasing complexity of these systems stems from a growing reliance on new, often noisy sensors and external connectivity for perception and decision-making. In addition to established safety concerns, cybersecurity has become essential, as communication interfaces and complex sensors introduce new vulnerabilities. Advances in environmental sensing further require attention to functional limitations that arise independently of malicious interference. Taken together, these developments present challenges in forming a comprehensive understanding of the contexts in which the systems are intended to operate safely. This, in turn, hinders the development of effective validation procedures and complicates efforts to substantiate claims of safety, security, and overall trustworthiness.

 

This PhD thesis advances the assurance of ADSs by integrating safety and cybersecurity into a unified assessment framework. The contributions are threefold: (1) context-dependent requirements; introducing technology-specific assessment templates for positioning, communication, and cybersecurity to enable more effective evaluation, together with a formalized operational design domain (ODD) for improved coverage and traceability; (2) multi-concern development management; demonstrating that co-engineered safety and security processes enhance completeness, supported by structured argument patterns, unified process models, and synchronization mechanisms to align assurance activities; and (3) independent assessment methods; developing a complementary testing approach called Assessment of Cybersecurity-informed Safety (AoCiS) and a systematic method for allocating test cases (METAFODD) to appropriate environments, enabling scalable scenario-based validation. Case studies and demonstrations show gains in efficiency, clarity, and completeness, while large-scale validation remains a challenge to be addressed in the future. Overall, the research presented in this thesis establishes structured and transparent methods to support independent and systematic assurance of safety and security in future evaluation efforts.

 

Place, publisher, year, edition, pages
Västerås: Mälardalen University, 2026
Series
Mälardalen University Press Dissertations, ISSN 1651-4238 ; 454
Keywords
safety assurance framework, type approval, operational design domain, scenario-based testing, functional safety, cybersecurity, validation, verification, CCAM
National Category
Software Engineering Robotics and automation
Research subject
Computer Science
Identifiers
urn:nbn:se:mdh:diva-74713 (URN)978-91-7485-741-2 (ISBN)
Public defence
2026-02-05, Kappa, Mälardalens universitet, Västerås, 13:30 (English)
Opponent
Supervisors
Funder
Knowledge Foundation, 20220130
Available from: 2025-12-03 Created: 2025-12-01 Last updated: 2025-12-08Bibliographically approved

Open Access in DiVA

No full text in DiVA

Other links

Publisher's full textScopus

Authority records

Hansson, HansPunnekkat, Sasikumar

Search in DiVA

By author/editor
Hansson, HansPunnekkat, Sasikumar
By organisation
Embedded Systems
Embedded Systems

Search outside of DiVA

GoogleGoogle Scholar

doi
isbn
urn-nbn

Altmetric score

doi
isbn
urn-nbn
Total: 343 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf