Bias in study design classification: A “retrospective” retrospective study

April 29, 2020 in College of Pharmacy, Virtual Poster Session Spring 2020

Background: Authors’ accurate use of terminology about epidemiological methods is important for clearly communicating about research to readers. Users of the medical literature rely on such information to guide them in their use of evidence to support patient care. However, historical changes in the meanings of epidemiologic terms could undermine these goals. For example, the term “retrospective” has historically been used to refer to a case-control study design. More recently, however, the term has come into wide usage as a description of a study’s data source.

Objectives: Using a corpus of human immunodeficiency virus (HIV) studies, we evaluated the association between use of the term retrospective in a study’s title/abstract and the likelihood that it would be indexed as a case-control study in PubMed.

Methods: We conducted a cohort study of PubMed research articles that were indexed with the MeSH term HIV from 1992-2017. We identified observational studies using a validated search filter for observational studies from the National Institute for Health and Care Excellence (NICE). For our primary objective, exposure of interest was the presence of the term retrospective in the title and/or abstract of an article, and the outcome was the PubMed Medical Subject Heading (MeSH) term for case-control studies. We estimated risk ratios (RRs) and 95% confidence intervals for the association between the exposure and the outcome overall and by year.

Results: A total of 88771 studies were identified meeting the eligibility criteria during the study period in our HIV corpus. Risk ratios (RR) in the HIV corpus for the association between the term retrospective and the MeSH term for case control studies was 29.21 (27.8, 30.7), and 26.4 (25.1, 27.8) when controlling for year. By year, the association was strongest in the first year (RR 72.4, 95% CI 46.0, 113.9), but then declined substantially in each subsequent year, stabilizing at a magnitude below 40% by 1998.

Conclusion: Use of the term retrospective is strongly associated with indexing with the MeSH term for case-control studies. This association initially decreased but has remained stable from 2005 onward. This suggests potential bias in study classification if use of the term retrospective is now more commonly associated with data source than with study design.