A Bayesian model that predicts the impact of Web searching on decision making

Research output: Contribution to journalArticleResearchpeer-review

Abstract

This study aimed to develop a model for predicting the impact of information access using Web searches, on human decision making. Models were constructed using a database of search behaviors and decisions of 75 clinicians, who answered questions about eight scenarios within 80 minutes in a controlled setting at a university computer laboratory. Bayesian models were developed with and without bias factors to account for anchoring, primacy, recency, exposure, and reinforcement decision biases. Prior probabilities were estimated from the population prior, from a personal prior calculated from presearch answers and confidence ratings provided by the participants, from an overall measure of willingness to switch belief before and after searching, and from a willingness to switch belief calculated in each individual scenario. The optimal Bayes model predicted user answers in 73.3% (95% Cl: 68.71 to 77.35%) of cases, and incorporated participants' willingness to switch belief before and after searching for each scenario, as well as the decision biases they encounter during the search journey. In most cases, it is possible to predict the impact of a sequence of documents retrieved by a Web search engine on a decision task without reference to the content or structure of the documents, but relying solely on a simple Bayesian model of belief revision.

LanguageEnglish
Pages873-880
Number of pages8
JournalJournal of the American Society for Information Science and Technology
Volume57
Issue number7
DOIs
Publication statusPublished - May 2006
Externally publishedYes

Fingerprint

Decision making
decision making
Switches
scenario
trend
Search engines
reinforcement
search engine
Reinforcement
confidence
rating
university

Cite this

@article{4a4bef561ce34ff0be2dea7b6fe452a0,
title = "A Bayesian model that predicts the impact of Web searching on decision making",
abstract = "This study aimed to develop a model for predicting the impact of information access using Web searches, on human decision making. Models were constructed using a database of search behaviors and decisions of 75 clinicians, who answered questions about eight scenarios within 80 minutes in a controlled setting at a university computer laboratory. Bayesian models were developed with and without bias factors to account for anchoring, primacy, recency, exposure, and reinforcement decision biases. Prior probabilities were estimated from the population prior, from a personal prior calculated from presearch answers and confidence ratings provided by the participants, from an overall measure of willingness to switch belief before and after searching, and from a willingness to switch belief calculated in each individual scenario. The optimal Bayes model predicted user answers in 73.3{\%} (95{\%} Cl: 68.71 to 77.35{\%}) of cases, and incorporated participants' willingness to switch belief before and after searching for each scenario, as well as the decision biases they encounter during the search journey. In most cases, it is possible to predict the impact of a sequence of documents retrieved by a Web search engine on a decision task without reference to the content or structure of the documents, but relying solely on a simple Bayesian model of belief revision.",
author = "Lau, {Annie Y S} and Coiera, {Enrico W.}",
year = "2006",
month = "5",
doi = "10.1002/asi.20377",
language = "English",
volume = "57",
pages = "873--880",
journal = "Journal of the American Society for Information Science and Technology",
issn = "1532-2882",
publisher = "John Wiley & Sons",
number = "7",

}

A Bayesian model that predicts the impact of Web searching on decision making. / Lau, Annie Y S; Coiera, Enrico W.

In: Journal of the American Society for Information Science and Technology, Vol. 57, No. 7, 05.2006, p. 873-880.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - A Bayesian model that predicts the impact of Web searching on decision making

AU - Lau, Annie Y S

AU - Coiera, Enrico W.

PY - 2006/5

Y1 - 2006/5

N2 - This study aimed to develop a model for predicting the impact of information access using Web searches, on human decision making. Models were constructed using a database of search behaviors and decisions of 75 clinicians, who answered questions about eight scenarios within 80 minutes in a controlled setting at a university computer laboratory. Bayesian models were developed with and without bias factors to account for anchoring, primacy, recency, exposure, and reinforcement decision biases. Prior probabilities were estimated from the population prior, from a personal prior calculated from presearch answers and confidence ratings provided by the participants, from an overall measure of willingness to switch belief before and after searching, and from a willingness to switch belief calculated in each individual scenario. The optimal Bayes model predicted user answers in 73.3% (95% Cl: 68.71 to 77.35%) of cases, and incorporated participants' willingness to switch belief before and after searching for each scenario, as well as the decision biases they encounter during the search journey. In most cases, it is possible to predict the impact of a sequence of documents retrieved by a Web search engine on a decision task without reference to the content or structure of the documents, but relying solely on a simple Bayesian model of belief revision.

AB - This study aimed to develop a model for predicting the impact of information access using Web searches, on human decision making. Models were constructed using a database of search behaviors and decisions of 75 clinicians, who answered questions about eight scenarios within 80 minutes in a controlled setting at a university computer laboratory. Bayesian models were developed with and without bias factors to account for anchoring, primacy, recency, exposure, and reinforcement decision biases. Prior probabilities were estimated from the population prior, from a personal prior calculated from presearch answers and confidence ratings provided by the participants, from an overall measure of willingness to switch belief before and after searching, and from a willingness to switch belief calculated in each individual scenario. The optimal Bayes model predicted user answers in 73.3% (95% Cl: 68.71 to 77.35%) of cases, and incorporated participants' willingness to switch belief before and after searching for each scenario, as well as the decision biases they encounter during the search journey. In most cases, it is possible to predict the impact of a sequence of documents retrieved by a Web search engine on a decision task without reference to the content or structure of the documents, but relying solely on a simple Bayesian model of belief revision.

UR - http://www.scopus.com/inward/record.url?scp=33646692933&partnerID=8YFLogxK

U2 - 10.1002/asi.20377

DO - 10.1002/asi.20377

M3 - Article

VL - 57

SP - 873

EP - 880

JO - Journal of the American Society for Information Science and Technology

T2 - Journal of the American Society for Information Science and Technology

JF - Journal of the American Society for Information Science and Technology

SN - 1532-2882

IS - 7

ER -