HSI2024: HSI2024 HUMAN SYSTEMS INTEGRATION CONFERENCE
PROGRAM FOR WEDNESDAY, AUGUST 28TH
Days:
previous day
next day
all days

View: session overviewtalk overview

09:00-10:00 Session 8: KeyNote 1: Cynthia Null
09:00
Taking measure of Human Systems Integration: A view from NASA

ABSTRACT. Building on work from recent NASA studies, Dr. Null will discuss challenges and successes of implementing Human System Integration approaches across mission life cycle. Topics will include the implications of focusing on human resilient performance for mission and system design; the use of quantitative analyses of human performance in development of a mission architecture; and the need to expand HSI metrics.

10:15-11:45 Session 9A: Design- 2: Interfaces, User centered design, and challenges
10:15
Supporting Means-Ends Reasoning In Cybersecurity-critical Case Management Using Integrated Ecological Interface Design Process
PRESENTER: Rohit Negi

ABSTRACT. Case management plays a critical role in safeguarding organizations from potential security threats by providing comprehensive and real-time insights into system activities, user behaviours, and anomalies. Effective case management can be conducted by leveraging the importance of meaningful information design for effectively handling cases, using HMI design processes, such as Integrated Ecological Interface Design (iEID). The practical reasoning of the analysts are first modelled using the abstraction decomposition space of iEID and is used as a basis for design ideations. Based on the insights of the field study and the ADS model, the information design and interface elements were developed. The interface uses a part-whole partitioning of information and supports the analyst's means-ends reasoning process. The paper demonstrates that human-centred design of security-critical systems is possible by using methods to design interfaces that support the analyst in the endeavour of case management in cybersecurity operations.

10:45
Systems Analysis Using the Vee Model and Concept of Operations in Human Systems Integration
PRESENTER: Paul Lambertson

ABSTRACT. Systems engineering is a holistic approach that typically does not include the human as an integrated part of the system. Having an organization that takes a more HSI (Human System Integration) approach will allow for requirements that integrate people with the technology needed to solve a problem from a user perspective. Using the systems Vee designed for this approach and integrating human information into a concept of operations and focusing on the user’s perspective we can create user centered requirements. This will be demonstrated using how disabilities can be addressed in an aircraft

11:00
User-Centered Design in Manufacturing: An Evaluation of Predictive and Reliability Displays

ABSTRACT. Modern manufacturing systems are becoming increasingly complex. Designing user interfaces that provide relevant information without causing information overload is challenging. This research aims to evaluate the effectiveness of predictive and reliability displays in modern manufacturing processes to support operators in completing all operations with quality, safety, and on schedule. The primary objective of this study is to assess the impact of automation failure and dynamic demands on per-formance, workload, workload, trust, and situation awareness during manufacturing operations. A representative test demonstrator tailored to the specific needs of aircraft manufacturing is used. This paper presents the primary objectives, research questions, experiment design, and the hypotheses to be tested in the evaluation studies.

11:15
Enabling Seamless Operation: Design Challenges

ABSTRACT. The article examines methods for facilitating the operation of socio-technical systems. Operational failure is due to diversion from procedures and situations defining normal activity. Sources of operational failure include triggers, exceptions, and uncoordinated activity. The article presents a model comprising three layers of the visibility of operational failure: incidents, errors, and accidents. The principles and methods discussed here focus on the need to maintain coordinated activity, and to mitigate the risks of exceptions. The protection from failure should be based on generic rules describing normal situations and activity. A model of HSI proposed here consists of interaction cycles, each comprising a supervisor, controllers, and service processes. Human decisions should rely on forecast of the system behavior in response to optional decisions. The preview information may be obtained by behavioral twins.

10:15-11:45 Session 9B: HSI Primer Writing Workshops
HSI Primer Writing Workshops

ABSTRACT. The INCOSE Human Systems Integration Working Group (HSI WG) recently released Volume 1 of a new series of Primer artefacts in September 2023. The purpose of the primer volumes are to provide contemporary guidance on the latest understanding of HSI from a cross-industry and transdisciplinary perspective. The first volume has been well received and interest in both HSI and the remaining Primer volumes is gaining momentum worldwide. This workshop will focus on Volume 2 (Fundamentals) and Volume 3 (Transdisciplinary HSI) and will bring together attendees with an interest in contributing as authors to the Primer.

Two primer writing workshops will be held during HSI 2024: Workshop 1- Overview, Review, Small Team Writing Allocation & First Writing Sprint. Workshop 2 – Writing Sprints, Review & Next Steps.

All are welcome to attend and learn more about the work of the HSI WG and feed into this important primer work. It is essential that the primers not only convey useful information but are also useful for individuals with different levels of HSI knowledge. The intention in these workshops is to create mixed sector, industry and level of knowledge in small teams in order to leverage the benefits of having multiple perspectives. To ensure efficiency, the workshops will be structured and facilitated. Vol 2 and 3 are approximately 70% complete, the outcomes of the workshop will be: - Identifying, prioritising and filling any gaps - General usability improvements

13:15-14:45 Session 11A: MBSE: Case Studies: HSI influences and Analysis
13:15
The Influence of Human-Systems Integration on “Fuzzy Front End” of Innovation: A MedTech Case Study

ABSTRACT. Human-Systems Integration (HSI) can be considered as the combination of Systems Engineering and Human-Centered Design approaches. To support HSI, the system of interest (SoI) and its broader context should be developed with a specific engineering design objective and consider humans part of the system. Using a MedTech industry case study, this paper explores the influence of including MedTech end-users, such as Healthcare Professionals, within the SoI definition. The MBSE approach models the “fuzzy front end” of innovation for the MedTech Combination Product and places the end-users within the SoI boundaries. The paper advocates that such an approach shifts the paradigm of ena-bling the human factors considerations to the early innovation phases rather than waiting for the first physical prototype.

13:45
Accident Case Study Analysis of Developmental Automated Driving System Collison

ABSTRACT. . The aim of the Case study is to produce a list of accident causal factors using the Cybernetic risk management model with the hybrid Swiss Cheese Model (SCM) and Management Oversight & Risk Tree (MORT) Methodology. The hybrid SCM/MORT methodology incorporates Jens Rasmussen’s risk management framework and thus, is able to identify latent failures conditions arising from the socio-technical system that embeds the system of interest (SOI). The results, it is argued, have an impact on Risk management, Decision making, and wider Human factors concerns that are relevant to Artificial Intelligence/ Machine Learning domain. The desk top study included collection of information and data that is publicly available to represent all relevant viewpoints to ensure completeness. The first part of the paper presents the Concepts, the Accident Causation Model, and the second part elaborates on the methodology and presents the results. It is noted that the Advanced Technologies Group (ATG) is no longer part of Uber Technologies, but the results are relevant to Aurora, a firm that purchased the ATG Group and continues the AV business.

14:15
Model-based Systems Engineering (MBSE) Enterprise Architecture Framework (EAF) with Human System Integration (HSI) – A Smart-City (SC) Case Study

ABSTRACT. This paper researches and analyzes how Model-based Systems Engineering (MBSE) methods can be applied to the construction industry in developing an Enterprise Architecture Framework (EAF) for long-term success of the Operations and Maintenance (O&M) of emerging Smart-Cities (SC). A properly built EAF complements an organization’s Digital Transformation (DT) effort, enabling the construction of these human-focused urban developments that purport sustainable practices in response to environmental threats heightened by typical city infrastructure. The complexity of an SC is comparable to architecting a System-of-Systems (SoS) with the imperative need to identify and account for emergent properties between systems when making design decisions. From a Systems Engineering (SE) perspective, the re-usability of standardized Architecture Frameworks (AF) and libraries built within an MBSE environment will decrease rework, therefore reducing cost and improving reliability of similar projects in the future. This paper will (1) review existing literature related to MBSE EAF implementation and results within the construction industry with an emphasis on SCs, (2) propose a Reference Architecture (RA) that extends an existing MBSE framework with customizations for SC construction, and (3) architect and evaluate The Line in Saudi Arabia as a case study. This research will lay the foundation for conclusions regarding the efficacy of practicing MBSE in construction as the domain becomes increasingly interconnected to “smarter” applications that require additional considerations, constraints, and technologies.

13:15-14:45 Session 11B: Aviation- 2: Analysis and Evaluation
Chair:
13:15
Human Reliability Analysis of Single-Pilot Operations Based on Improved CREAM Method
PRESENTER: Jiaqi Li

ABSTRACT. In order to effectively predict the human reliability of pilots under single-pilot operations (SPO) to ensure aviation safety, the CREAM method is improved to construct a prediction model of human error probability in line with SPO mode. Based on characteristics of the SPO and intelligent cockpit, the common performance conditions (CPCs) are modified and the weighting factors of cognitive function for improved CPCs are analyzed. A network of influenced relationship between CPCs is established using social network analysis method to adjust CPC dependency rules. In addition, new malfunctions in the intelligent aircraft that may arise are identified. In order to verify the improved CREAM method, a malfunction scenario of engine failure under SPO is designed, and the control mode of human cognitive activities corresponding to calculated results is tactical, which conforms to reality, indicating that the improved CREAM method is reasonable.

13:45
Multi-temporal Operational Efficiency Evaluation of Approach Control System Based on VIKOR
PRESENTER: Yuying Fan

ABSTRACT. The efficient operation of approach control system is one of its main tasks. The operational efficiency of the approach control system needs to be evaluated. Firstly, based on the analysis of the operational process of the approach control system, the influencing factors of the operational efficiency are considered from three aspects, namely, controllers' workload, airspace utilization rate and degree of flight delay. Using the fishbone diagram analysis method, the main efficiency influencing factors are concluded from the aspect of man-machine-environment-management. Then, the evaluation index system of the operational efficiency of the approach control system is designed. On this basis, a multi-period operational efficiency evaluation model of the approach control system is established based on VIKOR. Finally, the operational efficiency of the Xiamen Air Traffic Control Station operational system is evaluated as an example which validate the feasibility of the model.

14:15
Pilot’s roles in the Urban Air Mobility: individual capabilities for safety and security enterprise concerns
PRESENTER: Raquel Hoffmann

ABSTRACT. Safety and security are cross-cutting concerns of the Urban Air Mobility (UAM) ecosystem and critical for its future operations. Addressing those concerns requires an integrated approach, including stakeholders, people, processes, systems, and capabilities. While previous research has explored safety and security at the System-of-Systems (SoS) level, this paper embraces the Human Systems Integration (HSI) approach to investigate the pilot as an individual performer. In UAM’s early phases, the pilot is expected to be on board, controlling the vehicle and interacting with multiple systems and operators. This study employs the Unified Architecture Framework (UAF) to discern the pilot’s roles and capabilities consistent with the UAM as an enterprise. Results include views combining strategic resource exchanges and responsibilities associated with each pilot role. Lastly, we analyze the relationships among roles and capabilities and discuss the pilot’s critical capabilities for addressing situation awareness, security, and safety culture concerns. Leveraging the HSI approach allows for understanding the pilot’s perspective, facilitating informed decision-making, and fostering a culture of safety and security throughout the UAM ecosystem.

15:00-16:30 Session 12: Socio-Technical Systems: Organizational assessment and Change
15:00
A time-based approach for understanding human performance risks in sociotechnical systems: An integrative framework
PRESENTER: Belinda Cham

ABSTRACT. To achieve system success, it is critical to design sociotechnical systems that optimize human per-formance. To do so, we need to define and characterize the various aspects of human performance that we aim to enhance. In this paper, we introduce a novel time-based approach for conceptualizing human performance in sociotechnical systems. This approach explores how human performance can be considered over short-, medium- and long-term timeframes. We incorporate this time-based per-spective into a framework that organizes existing system design tools into different bundles, each focusing on specific aspects of human performance at various system levels. By integrating knowledge and methods from diverse system design perspectives, we emphasize the strategic ap-plication of human-centered design approaches. Our future work will refine this framework for practical implementation, collaborating with industry partners to ensure that human considerations are effectively integrated into systems design and acquisition processes

15:30
A Planning and Readiness Framework for Organisational Systems Change within Human Systems Integration

ABSTRACT. Human Systems Integration can be seen as the nexus between the human factors/ergonomics and systems engineering activities undertaken during the development of a system, with the entire systems lifecycle in mind. Human factors/ergonomics has three recognized domains; the physical, cognitive and organizational – whilst the physical domain is stereotypically most associated with the term ergonomics, and the cognitive domain has a well-established set of methods and tools, the consideration of the organizational domain lacks agreement in terms of the scope of both the organization in or as a system and the scope of activities. Whilst the exploration of human activity systems and envisaged organizational structures are performed early on in the conceptual systems development stage, there exists a challenge in planning, synchronizing and positioning an organisation to adapt for the planned technological system change. This paper explores the dual challenges in planning for the evolution of the organizational system as well as the considerations for organizational change that can and should feed into system design and development. A triple-axis framework is proposed that will enable HSI practitioners to consider the evolution of the organizational system and the extent of organizational change planning alongside the phases of the system lifecycle.

16:00
Soft Skills for Hard Missions: Ethnographic Insights of Mars 2020 Space Operation Team Dynamics
PRESENTER: So Young Kim

ABSTRACT. The Mars 2020 mission, characterized by its complex science and technological objectives and rapid decision-making requirements – presents a unique context for examining effective team collaboration across multiple disciplines. Conducted at the NASA Jet Propulsion Laboratory, the current ethnographic study spanned five Martian days (SOLs), focusing on the team decision-making processes among science, engineering, and space operation teams. Building on previous findings from the Mars Science Laboratory study, we delve deeper into the soft skills that facilitate deliberation among teams with varying technical expertise and agendas. Through systematic observation and coding of verbal exchanges, we identify key soft skills that enhance team efficiency and decision-making. Our findings reveal four overarching soft skill functions: Corporate Knowledge Gluers, Bridge Builders, Efficiency Optimizers, and Vibe Dispatchers. Together, these skills filled in knowledge gaps, fostered shared understanding, streamlined processes, and built trust and empathy in multidisciplinary teams. The study proposes a refined soft skills framework, applicable not only to space missions but also to other technically demanding and collaborative work environments. This framework serves as a guide for team design, emphasizing the integration of soft skills alongside technical competencies. Our results underscore the Gestalt of technical and interpersonal skills in achieving successful outcomes in complex science and engineering projects.