Assessing the safety of a new clinical decision support system for a national helpline

Nirvana Luckraj, Renee Strazzari, Enrico Coiera, Farah Magrabi

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

92 Downloads (Pure)

Abstract

We assessed the safety of a new clinical decision support system (CDSS) for nurses on Australia's national consumer helpline. Accuracy and safety of triage advice was assessed by testing the CDSS using 78 standardised patient vignettes (48 published and 30 proprietary). Testing was undertaken in two cycles using the CDSS vendor's online evaluation tool (Cycle 1: 47 vignettes; Cycle 2: 41 vignettes). Safety equivalence was examined by testing the existing CDSS with the 47 vignettes from Cycle 1. The new CDSS triaged 66% of vignettes correctly compared to 57% by the existing CDSS. 15% of vignettes were overtriaged by the new CDSS compared to 28% by the existing CDSS. 19% of vignettes were undertriaged by the new CDSS compared to 15% by the existing CDSS. Overall performance of the new CDSS appears consistent and comparable with current studies. The new CDSS is at least as safe as the old CDSS.

Original languageEnglish
Title of host publicationMEDINFO 2023 - The future is accessible
Subtitle of host publicationProceedings of the 19th World Congress on Medical and Health Informatics
EditorsJen Bichel-Findlay, Paula Otero, Philip Scott, Elaine Huesing
Place of PublicationAmsterdam
PublisherIOS Press
Pages514-518
Number of pages5
ISBN (Electronic)9781643684574
ISBN (Print)9781643684567
DOIs
Publication statusPublished - 25 Jan 2024
EventMEDINFO 2023 - Sydney, Australia
Duration: 8 Jul 202312 Jul 2023

Publication series

NameStudies in Health Technology and Informatics
PublisherIOS Press
Volume310
ISSN (Print)0926-9630
ISSN (Electronic)1879-8365

Conference

ConferenceMEDINFO 2023
Country/TerritoryAustralia
CitySydney
Period8/07/2312/07/23

Bibliographical note

Copyright the International Medical Informatics Association (IMIA) and IOS Press 2024. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.

Keywords

  • Clinical decision support
  • consumer
  • evaluation
  • health self-management
  • patient safety
  • symptom checker
  • telephone triage

Fingerprint

Dive into the research topics of 'Assessing the safety of a new clinical decision support system for a national helpline'. Together they form a unique fingerprint.

Cite this