Utilizing the SACADA system to collect simulator training data to inform human reliability analyses

Lack of appropriate human performance data for the development of human reliability analysis (HRA) methods has been identified as a key issue contributing to the method-to-method variability among the HRA methods. The United States Nuclear Regulatory Commission (NRC) worked with domain experts to develop the Scenario Authoring, Characterization, and Debriefing Application (SACADA) system to collect nuclear power plants' licensed operator simulator training and examination data to inform HRA. In the past two decades, significant improvements in understanding and modelling human performance in HRA have affected the perspectives of the types of data to be collected for HRA. A significant change is that human performance is strongly dependent on the context of the tasks to be performed. To incorporate this understanding, the SACADA data taxonomy collects the context and actual performance information of the training objective elements (TOEs) in nuclear plant operator simulator training. This provides a framework consistent with HRA to use context to estimate human error probabilities. It is recognized that measuring crew performance is equally important as improving operator training. SACADA is designed to support the nuclear trainers in capturing this important information that is used to identify training weaknesses and drive continuous improvement. This paper discusses the SACADA taxonomy, the SACADA system's functions, and the supporting software design to enable the SACADA system to be practically implemented in the nuclear power plants' operator simulator training program to collect data for tracking operator performance and HRA analysis.