Evaluating the effectiveness of clinical alerts: a signal detection approach.

Mei Sing Ong*, Enrico Coiera

*Corresponding author for this work

Research output: Contribution to journalConference paperpeer-review

12 Citations (Scopus)


Clinical alerts are widely used in healthcare to notify caregivers of critical information. Alerts can be presented through many different modalities, including verbal, paper and electronic. Increasingly, information technology is being used to automate alerts. Most applications, however, fall short in achieving the desired outcome. The objective of this study is twofold. First, we examine the effectiveness of verbal and written alerts in promoting adherence to infection control precautions during inpatient transfers to radiology. Second, we propose a quantitative framework based on Signal Detection Theory (SDT) for evaluating the effectiveness of clinical alerts. Our analysis shows that verbal alerts are much more effective than written alerts. Further, using precaution alerts as a case study, we demonstrate the application of SDT to evaluate the quality of alerts, and human behavior in handling alerts. We hypothesize that such technique can improve our understanding of computerized alert systems, and guide system redesign.

Original languageEnglish
Pages (from-to)1036-1044
Number of pages9
JournalAMIA Annual Symposium Proceedings
Publication statusPublished - 2011
EventAMIA Annual Symposium - Washington, US, Washington
Duration: 22 Oct 201125 Oct 2011


Dive into the research topics of 'Evaluating the effectiveness of clinical alerts: a signal detection approach.'. Together they form a unique fingerprint.

Cite this