Measurement properties of quality assessment tools for studies of diagnostic accuracy

Mark A. Kaizik*, Alessandra N. Garcia, Mark J. Hancock, Robert D. Herbert

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

3 Citations (Scopus)

Abstract

Objectives: To determine the reliability, internal consistency, measurement error, convergent validity, and floor and ceiling effects of three quality assessment tools commonly used to evaluate the quality of diagnostic test accuracy studies in physical therapy. A secondary aim was to describe the quality of a sample of diagnostic accuracy studies. Study design and setting: 50 studies were randomly selected from a comprehensive database of physical therapy-relevant diagnostic accuracy studies. Two reviewers independently rated each study with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS), Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Diagnostic Accuracy Quality Scale (DAQS) tools in random sequence. Results: Only 7% of QUADAS items, 14% of QUADAS-2 items, and 33% of DAQS items had at least moderate inter-rater reliability (kappa > 0.40). Internal consistency and convergent validity measures were acceptable (>0.70) in 33% and 50% of cases respectively. Floor or ceiling effects were not present in any tool. The quality of studies was mixed: most avoided case–control sampling strategies and used the same reference standard on all subjects, but many failed to enroll a consecutive or random sample of subjects or provide confidence intervals about estimates of diagnostic accuracy. Conclusion: The QUADAS, QUADAS-2 and DAQS tools provide unreliable estimates of the quality of studies of diagnostic accuracy in physical therapy.

Original languageEnglish
Pages (from-to)177-184
Number of pages8
JournalBrazilian Journal of Physical Therapy
Volume24
Issue number2
DOIs
Publication statusPublished - 1 Mar 2020

Keywords

  • Clinimetrics
  • Physical therapy
  • Psychometrics
  • Reliability

Fingerprint

Dive into the research topics of 'Measurement properties of quality assessment tools for studies of diagnostic accuracy'. Together they form a unique fingerprint.

Cite this