Tags:Decision-Making, Metrical Analysis, Physical Security and Vulnerability Analysis
Abstract:
Scoring-based systems are used worldwide to assess safety and security risks. Due to their ease of use, qualitative and semi-quantitative metrics are very popular. However, there may be the possibility that these scores do not accurately reflect the real risk, as was e.g. shown by Braband (2008) or Krisper (2021). In the worst case, this can lead to a misguided investment in measures. To avoid this, an adjustment of the scoring to a quantitative metric is required. The examples of the semi-quantitative Harnser metric and the quantitative intervention capability metric (ICM) from physical security are used to show in this paper how to transfer a well-defined performance mechanism for quantitatively calculating physical vulnerability into consistent scores. To enable the transfer, this paper performs a metrical analysis. The results of the Harnser metric are extended by estimated probability intervals and compared to the results of the ICM. Different types of score linkage and scales are used. Subsequently, we analyze measures to align the results of these two metrics, such as modifying the assignment of scores to scale categories or adjusting the probability intervals behind the scores. As an output, the metrical analysis generates rating scales for the Harnser scoring system that can be used to replicate quantitative vulnerability values. The results contribute to making more risk-appropriate decisions. Finally, we critically evaluate possibilities and limitations of metrical adaptability and summarize results.
References:
(Braband 2008) Braband, J. "Beschränktes Risiko." QZ. Qualität und Zuverlässigkeit 53.2 (2008): 28-33.
(Krisper 2021) Krisper, M. "Problems with Risk Matrices Using Ordinal Scales." arXiv preprint arXiv:2103.05440 (2021).
Risk Adjusting of Scoring-Based Metrics in Physical Security Assessment