TY - JOUR
T1 - Methods used to select results to include in meta-analyses of nutrition research
T2 - a meta-research study
AU - Kanukula, Raju
AU - McKenzie, Joanne E.
AU - Bero, Lisa
AU - Dai, Zhaoli
AU - McDonald, Sally
AU - Kroeger, Cynthia M.
AU - Korevaar, Elizabeth
AU - Page, Matthew J.
N1 - Copyright the Author(s) 2021. Version archived for private and non-commercial use with the permission of the author/s and according to publisher conditions. For further rights please contact the publisher.
PY - 2022/2
Y1 - 2022/2
N2 - Objectives: To investigate how often review authors encounter multiple results from included studies that are eligible for inclusion in a particular meta-analysis, and how often methods to select results are specified.Methods: MEDLINE and Epistemonikos were searched (January 2018 - June 2019) to identify systematic reviews with meta-analysis of the association between food/diet and health-related outcomes. A random sample of these reviews was selected, and for the first presented ('index') meta-analysis, rules used to select effect estimates to include in this meta-analysis were extracted from the reviews and their protocols. All effect estimates from the primary studies that were eligible for inclusion in the index meta-analyses were extracted (e.g. when a study report presented effect estimates for blood pressure at 3 weeks and 6 weeks, both unadjusted and adjusted for covariates, and all were eligible for inclusion in a meta-analysis of the effect of red meat consumption on blood pressure, we extracted all estimates and classified the study as having "multiplicity of results").Results: Forty-two systematic reviews with 325 studies (104 randomized, 221 non-randomized) were included; 14 reviews had a protocol. In 29% of review protocols and 69% of reviews, authors specified at least one decision rule to select effect estimates when multiple were available. In 68% of studies included in the index meta-analyses, there was at least one type of multiplicity of results.Conclusions: Authors of systematic reviews of nutrition studies should anticipate encountering multiplicity of results in the included primary studies. Specification of methods to handle multiplicity when designing reviews is therefore recommended.
AB - Objectives: To investigate how often review authors encounter multiple results from included studies that are eligible for inclusion in a particular meta-analysis, and how often methods to select results are specified.Methods: MEDLINE and Epistemonikos were searched (January 2018 - June 2019) to identify systematic reviews with meta-analysis of the association between food/diet and health-related outcomes. A random sample of these reviews was selected, and for the first presented ('index') meta-analysis, rules used to select effect estimates to include in this meta-analysis were extracted from the reviews and their protocols. All effect estimates from the primary studies that were eligible for inclusion in the index meta-analyses were extracted (e.g. when a study report presented effect estimates for blood pressure at 3 weeks and 6 weeks, both unadjusted and adjusted for covariates, and all were eligible for inclusion in a meta-analysis of the effect of red meat consumption on blood pressure, we extracted all estimates and classified the study as having "multiplicity of results").Results: Forty-two systematic reviews with 325 studies (104 randomized, 221 non-randomized) were included; 14 reviews had a protocol. In 29% of review protocols and 69% of reviews, authors specified at least one decision rule to select effect estimates when multiple were available. In 68% of studies included in the index meta-analyses, there was at least one type of multiplicity of results.Conclusions: Authors of systematic reviews of nutrition studies should anticipate encountering multiplicity of results in the included primary studies. Specification of methods to handle multiplicity when designing reviews is therefore recommended.
KW - Nutrition
KW - Meta-analysis
KW - Systematic review
KW - Multiplicity
KW - Eligibility criteria
KW - Decision rule
UR - http://purl.org/au-research/grants/nhmrc/1139997
UR - http://purl.org/au-research/grants/arc/DE200101618
UR - http://purl.org/au-research/grants/nhmrc/1143429
UR - http://www.scopus.com/inward/record.url?scp=85120804229&partnerID=8YFLogxK
U2 - 10.1016/j.jclinepi.2021.11.016
DO - 10.1016/j.jclinepi.2021.11.016
M3 - Article
C2 - 34780979
SN - 0895-4356
VL - 142
SP - 171
EP - 183
JO - Journal of Clinical Epidemiology
JF - Journal of Clinical Epidemiology
ER -