Measurement properties of quality assessment tools for studies of diagnostic accuracy

Mark A. Kaizik*, Alessandra N. Garcia, Mark J. Hancock, Robert D. Herbert

*Corresponding author for this work

    Research output: Contribution to journalArticlepeer-review

    5 Citations (Scopus)

    Abstract

    Objectives: To determine the reliability, internal consistency, measurement error, convergent validity, and floor and ceiling effects of three quality assessment tools commonly used to evaluate the quality of diagnostic test accuracy studies in physical therapy. A secondary aim was to describe the quality of a sample of diagnostic accuracy studies. Study design and setting: 50 studies were randomly selected from a comprehensive database of physical therapy-relevant diagnostic accuracy studies. Two reviewers independently rated each study with the Quality Assessment of Diagnostic Accuracy Studies (QUADAS), Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) and Diagnostic Accuracy Quality Scale (DAQS) tools in random sequence. Results: Only 7% of QUADAS items, 14% of QUADAS-2 items, and 33% of DAQS items had at least moderate inter-rater reliability (kappa > 0.40). Internal consistency and convergent validity measures were acceptable (>0.70) in 33% and 50% of cases respectively. Floor or ceiling effects were not present in any tool. The quality of studies was mixed: most avoided case–control sampling strategies and used the same reference standard on all subjects, but many failed to enroll a consecutive or random sample of subjects or provide confidence intervals about estimates of diagnostic accuracy. Conclusion: The QUADAS, QUADAS-2 and DAQS tools provide unreliable estimates of the quality of studies of diagnostic accuracy in physical therapy.

    Original languageEnglish
    Pages (from-to)177-184
    Number of pages8
    JournalBrazilian Journal of Physical Therapy
    Volume24
    Issue number2
    DOIs
    Publication statusPublished - 1 Mar 2020

    Keywords

    • Clinimetrics
    • Physical therapy
    • Psychometrics
    • Reliability

    Fingerprint

    Dive into the research topics of 'Measurement properties of quality assessment tools for studies of diagnostic accuracy'. Together they form a unique fingerprint.

    Cite this