Do user preferences align with human factors assessment scores of drug–drug interaction alerts?

David Lowenstein, Wu Yi Zheng, Rosemary Burke, Eliza Kenny, Anmol Sandhu, Meredith Makeham, Johanna Westbrook, Richard O. Day, Melissa T. Baysari

Research output: Contribution to journal › Article › Research › peer-review

Abstract

This study aimed to assess drug–drug interaction alert interfaces and to examine the relationship between compliance with human factors principles and user-preferences of alerts. Three reviewers independently evaluated drug–drug interaction alert interfaces in seven electronic systems using the Instrument-for-Evaluating-Human-Factors-Principles-in-Medication-Related-Decision-Support-Alerts (I-MeDeSA). Fifty-three doctors and pharmacists completed a survey to rate the alert interfaces from best to worst and reported on liked and disliked features. Human factors compliance and user-preferences of alerts were compared. Statistical analysis revealed no significant association between I-MeDeSA scores and user-preferences. However, the strengths and weaknesses of drug–drug interaction alerts from users’ perspectives were in-line with the human factors constructs evaluated by the I-MeDeSA. I-MeDeSA in its current form, is unable to identify alerts that are preferred by the users. The design principles assessed by I-MeDeSA appear to be sound, but its arbitrary allocation of points to each human factors construct may not reflect the relative importance that the end-users place on different aspects of alert design.

LanguageEnglish
JournalHealth Informatics Journal
DOIs
Publication statusE-pub ahead of print - 11 Apr 2019

Fingerprint

Drug Interactions
Pharmaceutical Preparations
Pharmacists
Compliance

Keywords

  • alerts
  • clinical decision support
  • drug–drug interaction
  • human factors
  • usability

Cite this

Lowenstein, David ; Zheng, Wu Yi ; Burke, Rosemary ; Kenny, Eliza ; Sandhu, Anmol ; Makeham, Meredith ; Westbrook, Johanna ; Day, Richard O. ; Baysari, Melissa T. / Do user preferences align with human factors assessment scores of drug–drug interaction alerts?. In: Health Informatics Journal. 2019.
@article{b5ac40f1da86452585c37cb34b8407e6,
title = "Do user preferences align with human factors assessment scores of drug–drug interaction alerts?",
abstract = "This study aimed to assess drug–drug interaction alert interfaces and to examine the relationship between compliance with human factors principles and user-preferences of alerts. Three reviewers independently evaluated drug–drug interaction alert interfaces in seven electronic systems using the Instrument-for-Evaluating-Human-Factors-Principles-in-Medication-Related-Decision-Support-Alerts (I-MeDeSA). Fifty-three doctors and pharmacists completed a survey to rate the alert interfaces from best to worst and reported on liked and disliked features. Human factors compliance and user-preferences of alerts were compared. Statistical analysis revealed no significant association between I-MeDeSA scores and user-preferences. However, the strengths and weaknesses of drug–drug interaction alerts from users’ perspectives were in-line with the human factors constructs evaluated by the I-MeDeSA. I-MeDeSA in its current form, is unable to identify alerts that are preferred by the users. The design principles assessed by I-MeDeSA appear to be sound, but its arbitrary allocation of points to each human factors construct may not reflect the relative importance that the end-users place on different aspects of alert design.",
keywords = "alerts, clinical decision support, drug–drug interaction, human factors, usability",
author = "David Lowenstein and Zheng, {Wu Yi} and Rosemary Burke and Eliza Kenny and Anmol Sandhu and Meredith Makeham and Johanna Westbrook and Day, {Richard O.} and Baysari, {Melissa T.}",
year = "2019",
month = "4",
day = "11",
doi = "10.1177/1460458219840210",
language = "English",
journal = "Health Informatics Journal",
issn = "1460-4582",
publisher = "SAGE Publications",

}

Lowenstein, D, Zheng, WY, Burke, R, Kenny, E, Sandhu, A, Makeham, M, Westbrook, J, Day, RO & Baysari, MT 2019, 'Do user preferences align with human factors assessment scores of drug–drug interaction alerts?', Health Informatics Journal. https://doi.org/10.1177/1460458219840210

Do user preferences align with human factors assessment scores of drug–drug interaction alerts? / Lowenstein, David; Zheng, Wu Yi; Burke, Rosemary; Kenny, Eliza; Sandhu, Anmol; Makeham, Meredith; Westbrook, Johanna; Day, Richard O.; Baysari, Melissa T.

In: Health Informatics Journal, 11.04.2019.

Research output: Contribution to journal › Article › Research › peer-review

TY - JOUR

T1 - Do user preferences align with human factors assessment scores of drug–drug interaction alerts?

AU - Lowenstein, David

AU - Zheng, Wu Yi

AU - Burke, Rosemary

AU - Kenny, Eliza

AU - Sandhu, Anmol

AU - Makeham, Meredith

AU - Westbrook, Johanna

AU - Day, Richard O.

AU - Baysari, Melissa T.

PY - 2019/4/11

Y1 - 2019/4/11

N2 - This study aimed to assess drug–drug interaction alert interfaces and to examine the relationship between compliance with human factors principles and user-preferences of alerts. Three reviewers independently evaluated drug–drug interaction alert interfaces in seven electronic systems using the Instrument-for-Evaluating-Human-Factors-Principles-in-Medication-Related-Decision-Support-Alerts (I-MeDeSA). Fifty-three doctors and pharmacists completed a survey to rate the alert interfaces from best to worst and reported on liked and disliked features. Human factors compliance and user-preferences of alerts were compared. Statistical analysis revealed no significant association between I-MeDeSA scores and user-preferences. However, the strengths and weaknesses of drug–drug interaction alerts from users’ perspectives were in-line with the human factors constructs evaluated by the I-MeDeSA. I-MeDeSA in its current form, is unable to identify alerts that are preferred by the users. The design principles assessed by I-MeDeSA appear to be sound, but its arbitrary allocation of points to each human factors construct may not reflect the relative importance that the end-users place on different aspects of alert design.

AB - This study aimed to assess drug–drug interaction alert interfaces and to examine the relationship between compliance with human factors principles and user-preferences of alerts. Three reviewers independently evaluated drug–drug interaction alert interfaces in seven electronic systems using the Instrument-for-Evaluating-Human-Factors-Principles-in-Medication-Related-Decision-Support-Alerts (I-MeDeSA). Fifty-three doctors and pharmacists completed a survey to rate the alert interfaces from best to worst and reported on liked and disliked features. Human factors compliance and user-preferences of alerts were compared. Statistical analysis revealed no significant association between I-MeDeSA scores and user-preferences. However, the strengths and weaknesses of drug–drug interaction alerts from users’ perspectives were in-line with the human factors constructs evaluated by the I-MeDeSA. I-MeDeSA in its current form, is unable to identify alerts that are preferred by the users. The design principles assessed by I-MeDeSA appear to be sound, but its arbitrary allocation of points to each human factors construct may not reflect the relative importance that the end-users place on different aspects of alert design.

KW - alerts

KW - clinical decision support

KW - drug–drug interaction

KW - human factors

KW - usability

UR - http://www.scopus.com/inward/record.url?scp=85064576342&partnerID=8YFLogxK

U2 - 10.1177/1460458219840210

DO - 10.1177/1460458219840210

M3 - Article

JO - Health Informatics Journal

T2 - Health Informatics Journal

JF - Health Informatics Journal

SN - 1460-4582

ER -

Lowenstein D, Zheng WY, Burke R, Kenny E, Sandhu A, Makeham M et al. Do user preferences align with human factors assessment scores of drug–drug interaction alerts? Health Informatics Journal. 2019 Apr 11. https://doi.org/10.1177/1460458219840210

Access to Document