Reconsidering stepped wedge cluster randomized trial designs with implementation periods: Fewer sequences or the parallel-group design with baseline and implementation periods are potentially more efficient

Philip M. Westgate, Shawn R. Nigam, Abigail B. Shoben

Research output: Contribution to journalArticlepeer-review

Abstract

Background/aims: When designing a cluster randomized trial, advantages and disadvantages of tentative designs must be weighed. The stepped wedge design is popular for multiple reasons, including its potential to increase power via improved efficiency relative to a parallel-group design. In many realistic settings, it will take time for clusters to fully implement the intervention. When designing the HEALing (Helping to End Addiction Long-termSM) Communities Study, implementation time was a major consideration, and we examined the efficiency and practicality of three designs. Specifically, a three-sequence stepped wedge design with implementation periods, a corresponding two-sequence modified design that is created by removing the middle sequence, and a parallel-group design with baseline and implementation periods. In this article, we study the relative efficiencies of these specific designs. More generally, we study the relative efficiencies of modified designs when the stepped wedge design with implementation periods has three or more sequences. We also consider different correlation structures. Methods: We compare efficiencies of stepped wedge designs with implementation periods consisting of three to nine sequences with a variety of corresponding designs. The three-sequence design is compared to the two-sequence modified design and to the parallel-group design with baseline and implementation periods analysed via analysis of covariance. Stepped wedge designs with implementation periods consisting of four or more sequences are compared to modified designs that remove all or a subset of ‘middle’ sequences. Efficiencies are based on the use of linear mixed effects models. Results: In the studied settings, the modified design is more efficient than the three-sequence stepped wedge design with implementation periods. The parallel-group design with baseline and implementation periods with analysis of covariance–based analysis is often more efficient than the three-sequence design. With respect to stepped wedge designs with implementation periods that are comprised of more sequences, there are often corresponding modified designs that improve efficiency. However, use of only the first and last sequences has the potential to be either relatively efficient or inefficient. Relative efficiency is impacted by the strength of the statistical correlation among outcomes from the same cluster; for example, the relative efficiencies of modified designs tend to be greater for smaller cluster auto-correlation values. Conclusion: If a three-sequence stepped wedge design with implementation periods is being considered for a future cluster randomized trial, then a corresponding modified design using only the first and last sequences should be considered if sole focus is on efficiency. However, a parallel-group design with baseline and implementation periods and analysis of covariance–based analysis can be a practical, efficient alternative. For stepped wedge designs with implementation periods and a larger number of sequences, modified versions that remove ‘middle’ sequences should be considered. Due to the potential sensitivity of design efficiencies, statistical correlation should be carefully considered.

Original languageEnglish
Pages (from-to)710-722
Number of pages13
JournalClinical Trials
Volume21
Issue number6
DOIs
StateAccepted/In press - 2024

Bibliographical note

Publisher Copyright:
© The Author(s) 2024.

Funding

This research was supported by the National Institutes of Health and the Substance Abuse and Mental Health Services Administration through the NIH HEAL (Helping to End Addiction Long-termSM) Initiative under award numbers UM1DA049406 and UM1DA049417 (ClinicalTrials.gov Identifier: NCT04111939). This study protocol (Pro00038088) was approved by Advarra Inc., the HEALing Communities Study single Institutional Review Board. The authors wish to acknowledge the participation of the HEALing Communities Study communities, community coalitions, community partner organizations and agencies and Community Advisory Boards and state government officials who partnered with us on this study. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health, the Substance Abuse and Mental Health Services Administration or the NIH HEAL InitiativeSM. The authors thank the associate editor and two reviewers for their comments that helped improve this paper. The author(s) disclosed receipt of the following financial support for the research, authorship and/or publication of this article: This research was supported by the National Institutes of Health through the NIH HEAL InitiativeSM under award numbers UM1DA049406 and UM1DA049417. The author(s) disclosed receipt of the following financial support for the research, authorship and/or publication of this article: This research was supported by the National Institutes of Health through the NIH HEAL Initiative under award numbers UM1DA049406 and UM1DA049417. This research was supported by the National Institutes of Health and the Substance Abuse and Mental Health Services Administration through the NIH HEAL (Helping to End Addiction Long-term) Initiative under award numbers UM1DA049406 and UM1DA049417 (ClinicalTrials.gov Identifier: NCT04111939). This study protocol (Pro00038088) was approved by Advarra Inc., the HEALing Communities Study single Institutional Review Board. The authors wish to acknowledge the participation of the HEALing Communities Study communities, community coalitions, community partner organizations and agencies and Community Advisory Boards and state government officials who partnered with us on this study. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health, the Substance Abuse and Mental Health Services Administration or the NIH HEAL Initiative. The authors thank the associate editor and two reviewers for their comments that helped improve this paper.

FundersFunder number
Substance Abuse and Mental Health Services Administration
National Institutes of Health (NIH)Pro00038088, NCT04111939, UM1DA049406, UM1DA049417
National Institutes of Health (NIH)

    Keywords

    • Cluster randomized trial
    • efficiency
    • implementation period
    • incomplete stepped wedge design
    • intra-cluster correlation coefficient
    • parallel-group design

    ASJC Scopus subject areas

    • Pharmacology

    Fingerprint

    Dive into the research topics of 'Reconsidering stepped wedge cluster randomized trial designs with implementation periods: Fewer sequences or the parallel-group design with baseline and implementation periods are potentially more efficient'. Together they form a unique fingerprint.

    Cite this