The impact of an online evidence system on confidence in decision making in a controlled setting

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Objective. To examine the impact of online evidence retrieval on clinicians' decision-making confidence and to determine if this differs for experienced doctors and nurses. Methods. A sample of 44 doctors and 31 clinical nurse consultants (CNCs) answered 8 clinical scenarios (600 scenario answers) before and after the use of online evidence resources. Clinicians rated their confidence in scenario answers and in the evidence they found using the information system. Results. Prior to using online evidence, 37% of doctors and 18% of CNCs answered the scenarios correctly. These clinicians were more confident (56% very confident or confident) in their answers than those with incorrect (34%) answers. Doctors with incorrect answers prior to searching rated their confidence significantly higher than did nurses who were incorrect. After searching, both groups answered 50% of scenarios correctly. Clinicians with correct answers had greater confidence in the evidence found compared to those with incorrect answers. Doctors were more confident in evidence found confirming an initially correct answer than were nurses. More than 50% of clinicians who persisted with an incorrect answer after searching reported that they were confident or very confident in the evidence found. Clinicians who did not know scenario answers before searching placed equal confidence in evidence that led them to a correct or incorrect answer. Conclusions. The information obtained from an online evidence system influenced clinicians' confidence in their answers to the clinical scenarios. The relationship between confidence in answers and correctness is complex. Both existing knowledge and professional role were mediating factors. The finding that many clinicians placed confidence in information that led them to incorrect answers warrants further investigation.

LanguageEnglish
Pages178-185
Number of pages8
JournalMedical Decision Making
Volume25
Issue number2
DOIs
Publication statusPublished - Mar 2005
Externally publishedYes

Fingerprint

Online Systems
Decision Making
Nurses
Consultants
Professional Role
Information Systems

Cite this

@article{3e6ca838ac544a999dd2c1d36a8ae18f,
title = "The impact of an online evidence system on confidence in decision making in a controlled setting",
abstract = "Objective. To examine the impact of online evidence retrieval on clinicians' decision-making confidence and to determine if this differs for experienced doctors and nurses. Methods. A sample of 44 doctors and 31 clinical nurse consultants (CNCs) answered 8 clinical scenarios (600 scenario answers) before and after the use of online evidence resources. Clinicians rated their confidence in scenario answers and in the evidence they found using the information system. Results. Prior to using online evidence, 37{\%} of doctors and 18{\%} of CNCs answered the scenarios correctly. These clinicians were more confident (56{\%} very confident or confident) in their answers than those with incorrect (34{\%}) answers. Doctors with incorrect answers prior to searching rated their confidence significantly higher than did nurses who were incorrect. After searching, both groups answered 50{\%} of scenarios correctly. Clinicians with correct answers had greater confidence in the evidence found compared to those with incorrect answers. Doctors were more confident in evidence found confirming an initially correct answer than were nurses. More than 50{\%} of clinicians who persisted with an incorrect answer after searching reported that they were confident or very confident in the evidence found. Clinicians who did not know scenario answers before searching placed equal confidence in evidence that led them to a correct or incorrect answer. Conclusions. The information obtained from an online evidence system influenced clinicians' confidence in their answers to the clinical scenarios. The relationship between confidence in answers and correctness is complex. Both existing knowledge and professional role were mediating factors. The finding that many clinicians placed confidence in information that led them to incorrect answers warrants further investigation.",
author = "Westbrook, {Johanna I.} and Gosling, {A. Sophie} and Coiera, {Enrico W.}",
year = "2005",
month = "3",
doi = "10.1177/0272989X05275155",
language = "English",
volume = "25",
pages = "178--185",
journal = "Medical Decision Making",
issn = "0272-989X",
publisher = "SAGE Publications",
number = "2",

}

The impact of an online evidence system on confidence in decision making in a controlled setting. / Westbrook, Johanna I.; Gosling, A. Sophie; Coiera, Enrico W.

In: Medical Decision Making, Vol. 25, No. 2, 03.2005, p. 178-185.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - The impact of an online evidence system on confidence in decision making in a controlled setting

AU - Westbrook, Johanna I.

AU - Gosling, A. Sophie

AU - Coiera, Enrico W.

PY - 2005/3

Y1 - 2005/3

N2 - Objective. To examine the impact of online evidence retrieval on clinicians' decision-making confidence and to determine if this differs for experienced doctors and nurses. Methods. A sample of 44 doctors and 31 clinical nurse consultants (CNCs) answered 8 clinical scenarios (600 scenario answers) before and after the use of online evidence resources. Clinicians rated their confidence in scenario answers and in the evidence they found using the information system. Results. Prior to using online evidence, 37% of doctors and 18% of CNCs answered the scenarios correctly. These clinicians were more confident (56% very confident or confident) in their answers than those with incorrect (34%) answers. Doctors with incorrect answers prior to searching rated their confidence significantly higher than did nurses who were incorrect. After searching, both groups answered 50% of scenarios correctly. Clinicians with correct answers had greater confidence in the evidence found compared to those with incorrect answers. Doctors were more confident in evidence found confirming an initially correct answer than were nurses. More than 50% of clinicians who persisted with an incorrect answer after searching reported that they were confident or very confident in the evidence found. Clinicians who did not know scenario answers before searching placed equal confidence in evidence that led them to a correct or incorrect answer. Conclusions. The information obtained from an online evidence system influenced clinicians' confidence in their answers to the clinical scenarios. The relationship between confidence in answers and correctness is complex. Both existing knowledge and professional role were mediating factors. The finding that many clinicians placed confidence in information that led them to incorrect answers warrants further investigation.

AB - Objective. To examine the impact of online evidence retrieval on clinicians' decision-making confidence and to determine if this differs for experienced doctors and nurses. Methods. A sample of 44 doctors and 31 clinical nurse consultants (CNCs) answered 8 clinical scenarios (600 scenario answers) before and after the use of online evidence resources. Clinicians rated their confidence in scenario answers and in the evidence they found using the information system. Results. Prior to using online evidence, 37% of doctors and 18% of CNCs answered the scenarios correctly. These clinicians were more confident (56% very confident or confident) in their answers than those with incorrect (34%) answers. Doctors with incorrect answers prior to searching rated their confidence significantly higher than did nurses who were incorrect. After searching, both groups answered 50% of scenarios correctly. Clinicians with correct answers had greater confidence in the evidence found compared to those with incorrect answers. Doctors were more confident in evidence found confirming an initially correct answer than were nurses. More than 50% of clinicians who persisted with an incorrect answer after searching reported that they were confident or very confident in the evidence found. Clinicians who did not know scenario answers before searching placed equal confidence in evidence that led them to a correct or incorrect answer. Conclusions. The information obtained from an online evidence system influenced clinicians' confidence in their answers to the clinical scenarios. The relationship between confidence in answers and correctness is complex. Both existing knowledge and professional role were mediating factors. The finding that many clinicians placed confidence in information that led them to incorrect answers warrants further investigation.

UR - http://www.scopus.com/inward/record.url?scp=11144236724&partnerID=8YFLogxK

U2 - 10.1177/0272989X05275155

DO - 10.1177/0272989X05275155

M3 - Article

VL - 25

SP - 178

EP - 185

JO - Medical Decision Making

T2 - Medical Decision Making

JF - Medical Decision Making

SN - 0272-989X

IS - 2

ER -