TY - JOUR
T1 - A reliability and usability study of TRACEr-RAV
T2 - The technique for the retrospective analysis of cognitive errors - For rail, Australian version
AU - Baysari, Melissa T.
AU - Caponecchia, Carlo
AU - McIntosh, Andrew S.
PY - 2011/11
Y1 - 2011/11
N2 - The aim of this study was to compare the usability and reliability of two human error identification tools: TRACEr-Rail (developed by the Rail Safety and Standards Board in the UK) and TRACEr-RAV (an Australian specific version of the tool). Following an attempt to modify TRACEr-Rail to more appropriately suit the Australian rail context, it was predicted that TRACEr-RAV would be rated as more usable and be applied more consistently by Australian users than TRACEr-Rail. In Experiment 1, twenty-five rail employees used either TRACEr-Rail or TRACEr-RAV1 to extract and classify errors from six Australian rail incident reports. In Experiment 2, eleven university students used both TRACEr-Rail and TRACEr-RAV2 to extract and classify errors from three incident summaries. The results revealed that although modification of TRACEr-Rail to become TRACEr-RAV1 and TRACEr-RAV2 did not result in improved inter-rater reliability, modification resulted in improved ratings of usability in Experiment 2. Most participants in Experiment 2 preferred TRACEr-RAV2 to TRACEr-Rail. The poor inter-rater reliability observed was most likely the result of inadequate training, limited practice in using the tools, and insufficient human factors knowledge.
AB - The aim of this study was to compare the usability and reliability of two human error identification tools: TRACEr-Rail (developed by the Rail Safety and Standards Board in the UK) and TRACEr-RAV (an Australian specific version of the tool). Following an attempt to modify TRACEr-Rail to more appropriately suit the Australian rail context, it was predicted that TRACEr-RAV would be rated as more usable and be applied more consistently by Australian users than TRACEr-Rail. In Experiment 1, twenty-five rail employees used either TRACEr-Rail or TRACEr-RAV1 to extract and classify errors from six Australian rail incident reports. In Experiment 2, eleven university students used both TRACEr-Rail and TRACEr-RAV2 to extract and classify errors from three incident summaries. The results revealed that although modification of TRACEr-Rail to become TRACEr-RAV1 and TRACEr-RAV2 did not result in improved inter-rater reliability, modification resulted in improved ratings of usability in Experiment 2. Most participants in Experiment 2 preferred TRACEr-RAV2 to TRACEr-Rail. The poor inter-rater reliability observed was most likely the result of inadequate training, limited practice in using the tools, and insufficient human factors knowledge.
UR - http://www.scopus.com/inward/record.url?scp=79960260021&partnerID=8YFLogxK
UR - http://purl.org/au-research/grants/arc/LP0667799
U2 - 10.1016/j.apergo.2011.01.009
DO - 10.1016/j.apergo.2011.01.009
M3 - Article
C2 - 21354553
AN - SCOPUS:79960260021
SN - 0003-6870
VL - 42
SP - 852
EP - 859
JO - Applied Ergonomics
JF - Applied Ergonomics
IS - 6
ER -