Architecture for knowledge-based and federated search of online clinical evidence

Enrico Coiera, Martin Walther, Ken Nguyen, Nigel H. Lovell

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Background: It is increasingly difficult for clinicians to keep up-to-date with the rapidly growing biomedical literature. Online evidence retrieval methods are now seen as a core tool to support evidence-based health practice. However, standard search engine technology is not designed to manage the many different types of evidence sources that are available or to handle the very different information needs of various clinical groups, who often work in widely different settings.Objectives: The objectives of this paper are (1) to describe the design considerations and system architecture of a wrapper-mediator approach to federate search system design, including the use of knowledge-based, meta-search filters, and (2) to analyze the implications of system design choices on performance measurements.Methods: A trial was performed to evaluate the technical performance of a federated evidence retrieval system, which provided access to eight distinct online resources, including e-journals, PubMed, and electronic guidelines. The Quick Clinical system architecture utilized a universal query language to reformulate queries internally and utilized meta-search filters to optimize search strategies across resources. We recruited 227 family physicians from across Australia who used the system to retrieve evidence in a routine clinical setting over a 4-week period. The total search time for a query was recorded, along with the duration of individual queries sent to different online resources.Results: Clinicians performed 1662 searches over the trial. The average search duration was 4.9 ± 3.2 s (N = 1662 searches). Mean search duration to the individual sources was between 0.05 s and 4.55 s. Average system time (ie, system overhea d) was 0.12 s.Conclusions: The relatively small system overhead compared to the average time it takes to perform a search for an individual source shows that the system achieves a good trade-off between performance and reliability. Furthermore, despite the additional effort required to incorporate the capabilities of each individual source (to improve the quality of search results), system maintenance requires only a small additional overhead.

LanguageEnglish
Article numbere52
Pages1-15
Number of pages15
JournalJournal of Medical Internet Research
Volume7
Issue number5
DOIs
Publication statusPublished - Oct 2005
Externally publishedYes

Fingerprint

Search Engine
Evidence-Based Practice
Family Physicians
Systems Analysis
PubMed
Language
Maintenance
Guidelines
Technology
Health

Keywords

  • Clinical decision support systems
  • Evidence-based medicine
  • Information retrieval
  • Meta-search filters

Cite this

Coiera, Enrico ; Walther, Martin ; Nguyen, Ken ; Lovell, Nigel H. / Architecture for knowledge-based and federated search of online clinical evidence. In: Journal of Medical Internet Research. 2005 ; Vol. 7, No. 5. pp. 1-15.
@article{222c56862f3444f2928191b8f1325733,
title = "Architecture for knowledge-based and federated search of online clinical evidence",
abstract = "Background: It is increasingly difficult for clinicians to keep up-to-date with the rapidly growing biomedical literature. Online evidence retrieval methods are now seen as a core tool to support evidence-based health practice. However, standard search engine technology is not designed to manage the many different types of evidence sources that are available or to handle the very different information needs of various clinical groups, who often work in widely different settings.Objectives: The objectives of this paper are (1) to describe the design considerations and system architecture of a wrapper-mediator approach to federate search system design, including the use of knowledge-based, meta-search filters, and (2) to analyze the implications of system design choices on performance measurements.Methods: A trial was performed to evaluate the technical performance of a federated evidence retrieval system, which provided access to eight distinct online resources, including e-journals, PubMed, and electronic guidelines. The Quick Clinical system architecture utilized a universal query language to reformulate queries internally and utilized meta-search filters to optimize search strategies across resources. We recruited 227 family physicians from across Australia who used the system to retrieve evidence in a routine clinical setting over a 4-week period. The total search time for a query was recorded, along with the duration of individual queries sent to different online resources.Results: Clinicians performed 1662 searches over the trial. The average search duration was 4.9 ± 3.2 s (N = 1662 searches). Mean search duration to the individual sources was between 0.05 s and 4.55 s. Average system time (ie, system overhea d) was 0.12 s.Conclusions: The relatively small system overhead compared to the average time it takes to perform a search for an individual source shows that the system achieves a good trade-off between performance and reliability. Furthermore, despite the additional effort required to incorporate the capabilities of each individual source (to improve the quality of search results), system maintenance requires only a small additional overhead.",
keywords = "Clinical decision support systems, Evidence-based medicine, Information retrieval, Meta-search filters",
author = "Enrico Coiera and Martin Walther and Ken Nguyen and Lovell, {Nigel H.}",
year = "2005",
month = "10",
doi = "10.2196/jmir.7.5.e52",
language = "English",
volume = "7",
pages = "1--15",
journal = "Journal of Medical Internet Research",
issn = "1438-8871",
publisher = "JMIR PUBLICATIONS, INC",
number = "5",

}

Architecture for knowledge-based and federated search of online clinical evidence. / Coiera, Enrico; Walther, Martin; Nguyen, Ken; Lovell, Nigel H.

In: Journal of Medical Internet Research, Vol. 7, No. 5, e52, 10.2005, p. 1-15.

Research output: Contribution to journalArticleResearchpeer-review

TY - JOUR

T1 - Architecture for knowledge-based and federated search of online clinical evidence

AU - Coiera, Enrico

AU - Walther, Martin

AU - Nguyen, Ken

AU - Lovell, Nigel H.

PY - 2005/10

Y1 - 2005/10

N2 - Background: It is increasingly difficult for clinicians to keep up-to-date with the rapidly growing biomedical literature. Online evidence retrieval methods are now seen as a core tool to support evidence-based health practice. However, standard search engine technology is not designed to manage the many different types of evidence sources that are available or to handle the very different information needs of various clinical groups, who often work in widely different settings.Objectives: The objectives of this paper are (1) to describe the design considerations and system architecture of a wrapper-mediator approach to federate search system design, including the use of knowledge-based, meta-search filters, and (2) to analyze the implications of system design choices on performance measurements.Methods: A trial was performed to evaluate the technical performance of a federated evidence retrieval system, which provided access to eight distinct online resources, including e-journals, PubMed, and electronic guidelines. The Quick Clinical system architecture utilized a universal query language to reformulate queries internally and utilized meta-search filters to optimize search strategies across resources. We recruited 227 family physicians from across Australia who used the system to retrieve evidence in a routine clinical setting over a 4-week period. The total search time for a query was recorded, along with the duration of individual queries sent to different online resources.Results: Clinicians performed 1662 searches over the trial. The average search duration was 4.9 ± 3.2 s (N = 1662 searches). Mean search duration to the individual sources was between 0.05 s and 4.55 s. Average system time (ie, system overhea d) was 0.12 s.Conclusions: The relatively small system overhead compared to the average time it takes to perform a search for an individual source shows that the system achieves a good trade-off between performance and reliability. Furthermore, despite the additional effort required to incorporate the capabilities of each individual source (to improve the quality of search results), system maintenance requires only a small additional overhead.

AB - Background: It is increasingly difficult for clinicians to keep up-to-date with the rapidly growing biomedical literature. Online evidence retrieval methods are now seen as a core tool to support evidence-based health practice. However, standard search engine technology is not designed to manage the many different types of evidence sources that are available or to handle the very different information needs of various clinical groups, who often work in widely different settings.Objectives: The objectives of this paper are (1) to describe the design considerations and system architecture of a wrapper-mediator approach to federate search system design, including the use of knowledge-based, meta-search filters, and (2) to analyze the implications of system design choices on performance measurements.Methods: A trial was performed to evaluate the technical performance of a federated evidence retrieval system, which provided access to eight distinct online resources, including e-journals, PubMed, and electronic guidelines. The Quick Clinical system architecture utilized a universal query language to reformulate queries internally and utilized meta-search filters to optimize search strategies across resources. We recruited 227 family physicians from across Australia who used the system to retrieve evidence in a routine clinical setting over a 4-week period. The total search time for a query was recorded, along with the duration of individual queries sent to different online resources.Results: Clinicians performed 1662 searches over the trial. The average search duration was 4.9 ± 3.2 s (N = 1662 searches). Mean search duration to the individual sources was between 0.05 s and 4.55 s. Average system time (ie, system overhea d) was 0.12 s.Conclusions: The relatively small system overhead compared to the average time it takes to perform a search for an individual source shows that the system achieves a good trade-off between performance and reliability. Furthermore, despite the additional effort required to incorporate the capabilities of each individual source (to improve the quality of search results), system maintenance requires only a small additional overhead.

KW - Clinical decision support systems

KW - Evidence-based medicine

KW - Information retrieval

KW - Meta-search filters

UR - http://www.scopus.com/inward/record.url?scp=29144484293&partnerID=8YFLogxK

U2 - 10.2196/jmir.7.5.e52

DO - 10.2196/jmir.7.5.e52

M3 - Article

VL - 7

SP - 1

EP - 15

JO - Journal of Medical Internet Research

T2 - Journal of Medical Internet Research

JF - Journal of Medical Internet Research

SN - 1438-8871

IS - 5

M1 - e52

ER -