Skip to main content

A guide to the reporting of protocols of pilot and feasibility trials

Abstract

Publishing protocols of trials including protocols of pilot and feasibility trials—designed to inform the designs of main trials—has been advocated as an important strategy towards improving transparency in the conduct and reporting of main trials and pilot/feasibility trials. This editorial aims to provide some general guidance on how to report protocols of pilot and feasibility trials, drawing upon two available resources—the CONSORT extension to pilot trials and the SPIRIT guideline for main trials. We describe how these might be adapted for the reporting of protocol manuscripts of pilot and feasibility trials for submission in Pilot and Feasibility Studies journal.

Introduction

The journal Pilot and Feasibility Studies (PFS) was launched in 2015 to provide a forum for publishing pilot and feasibility research. PFS’s scope “encompasses all aspects of the design, conduct and reporting of pilot and feasibility studies in biomedicine. The journal publishes research articles that are intended to directly influence future clinical trials or large-scale observational studies, as well as protocols….” [1]. First published in 1996 [2] and updated in 2010 [3], the CONSORT Statement was developed to improve the transparency of the reporting of randomised controlled trials (RCTs). CONSORT was then extended to cover various types of study outcomes [4, 5], RCT designs [6,7,8,9], and types of interventions [10,11,12]. In 2016, we developed the CONSORT extension to pilot trials to help researchers who conduct pilot and feasibility trials to report them in a way that allows readers to understand what had been done, what the results were, and how to interpret them [13,14,15]. For the results of pilot and feasibility trials, PFS now requires that submissions include the checklist from the CONSORT extension to pilot trials [1].

Publishing protocols of trials has been advocated as an important strategy towards improving transparency in the conduct and reporting of trials [16, 17]. This has allowed investigators to assess consistency between protocols and final reports of trials [18], as a way to hold authors more accountable and to help readers to better assess the validity of the final trial results. Most importantly, it has helped readers to better understand the conduct and applicability of the trial and better apply the results to patient care.

Today, publication of trial protocols in scientific journals has become more commonplace. The SPIRIT (Standard Protocol Items: Recommendations for Interventional Trials) guideline was published in 2013. It aims to improve the completeness and quality of reporting clinical trial protocols [19]. SPIRIT defines a protocol as “a document that provides sufficient detail to enable understanding of the background, rationale, objectives, study population, interventions, methods, statistical analyses, ethical considerations, dissemination plans, and administration of the trial; replication of key aspects of trial methods and conduct; and appraisal of the trial’s scientific and ethical rigour from ethics approval to dissemination of results” [19]. The guideline includes a full statement, a checklist of items that should be included in a trial protocol publication, and a detailed explanation of the importance of each item, with examples of best practices [20].

Reporting guidelines such as SPIRIT have several potential benefits to various stakeholders [21]: (1) for funding agencies—to use guideline items as part of a grant submission template and evaluation criteria (e.g. Swiss National Science Foundation [http://www.snf.ch/SiteCollectionDocuments/IICT_2018_Proposal_Template.docx, http://www.snf.ch/en/funding/programmes/iict/Pages/default.aspx#Documents] and National Health and Medical Research Council [https://www.australianclinicaltrials.gov.au/clinical-trials-toolkit]); (ii) for authors—to use the guideline checklist as a template when preparing trial manuscripts for publication; (iii) for peer-reviewers of journal manuscripts—to endorse the guideline in their instructions to authors and to require the guideline checklist to be included as part of their submission process (e.g. Trials [https://trialsjournal.biomedcentral.com/]) and BMJ Open [https://bmjopen.bmj.com/]); and (iv) for higher education institutions—to endorse guidelines and ensure that they are incorporated into their institutional research publication policies (see http://www.spirit-statement.org/about-spirit/spirit-endorsement/). The absence of reporting guidelines can be a serious barrier to the full and transparent dissemination of knowledge through scientific research—reflecting poorly on all stakeholders and potentially leading to biased reporting, waste of resources, and unusable research that is hard or impossible to replicate.

Against this backdrop, a call for publication of protocol guidance for pilot and feasibility studies was made in 2016 [22]. While this work has been planned by the same working group that developed the CONSORT extension to pilot trials, which includes ourselves, we recognise that some guidance from the journal editors would be helpful. This editorial aims to provide some general guidance in the interim, drawing upon two sources—the CONSORT extension to pilot trials and the SPIRIT guideline for main trials. We describe how these might be adapted for the reporting of protocols of pilot and feasibility trials.

Guidance for writing protocols of pilot and feasibility trials for submission to PFS journal

Since its inception in 2015, the PFS journal has routinely published articles reporting protocols for pilot and feasibility studies. PFS’s policy is that protocol manuscripts should be submitted to the journal before the recruitment and follow-up of study participants have been completed. To date, there is no specific evidence-based guidance describing the items that should be included when reporting the protocol for a pilot and feasibility trial. We suggest that it is helpful to refer to the CONSORT extension to pilot trials for more elaboration on items to report at the start of the work when planning the study protocol, while concurrently adapting the SPIRIT checklist for reporting the protocol of a pilot trial.

However, SPIRIT is designed to comprehensively report main trials of effectiveness. This is not the primary aim of a pilot trial, which aims to test a set of feasibility objectives to ensure the main trial is viable. We suggest adapting SPIRIT for manuscripts that report the protocols of pilot and feasibility trials. The SPIRIT checklist can be found on the SPIRIT Statement website at http://www.spirit-statement.org/. For example, all Background elements of the SPIRIT guideline would be suitable to consider in the Background section of the protocol for a pilot trial, supplemented by the item from the CONSORT extension (item 2a) that specifies the reason for the pilot trial set in the context of the main trial. The CONSORT extension to pilot trials (item 2b) also stresses the importance of giving clear aims and feasibility objectives for the pilot trial at the end of the introduction. These would provide the main focus of the pilot trial protocol (replacing SPIRIT item 7).

In the Methods section, rather than describing the primary and secondary outcome measures as stipulated in SPIRIT (item 12), we should instead describe the methods for the primary and secondary feasibility outcomes, for example recruitment rate, compliance in data collection or acceptability of the intervention to patients and health practitioners, or secondary patient-centred outcome measures to be used for data collection (CONSORT extension item 6a). Similar adaptations should be made for SPIRIT item 14 (CONSORT item 7a) on sample size and SPIRIT item 20a (CONSORT item 12a) on data analysis. Thus, one can consider the SPIRIT elements in the context of assessment of feasibility as the primary aim for a pilot trial and therefore adapt them appropriately, supplemented with reference to the CONSORT extension explanations. It is important to note that all elements of the Background and Methods are generally part of the design of a trial, and therefore, they would typically be addressed in the protocol of the pilot trial, which is addressing any uncertainties in study design.

Headway has been made into producing a guideline for reporting pilot trial protocols. The next step of the working group is to convene a consensus meeting to discuss the suggested adaptations with the aim of producing a final checklist that can be used to write the statement and explanatory paper for the SPIRIT extension to protocols of pilot and feasibility studies. In the meantime, we hope the suggested adaptations will be useful to authors in reporting protocols of pilot and feasibility studies submitted to PFS.

References

  1. Pilot and Feasibility Studies website: https://pilotfeasibilitystudies.biomedcentral.com/ (last accessed on 7 Feb 2019).

  2. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996;276(8):637–9.

    Article  CAS  Google Scholar 

  3. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. BMJ (Clinical research ed). 2010;340:c332.

    Article  Google Scholar 

  4. Calvert M, Blazeby J, Altman DG, Revicki DA, Moher D, Brundage MD, et al. Reporting of patient-reported outcomes in randomized trials: the CONSORT PRO extension. JAMA. 2013;309(8):814–22.

    Article  CAS  Google Scholar 

  5. Ioannidis J, Evans SJ, Gøtzsche PC, et al. Better reporting of harms in randomized trials: an extension of the CONSORT statement. Ann Intern Med. 2004;141(10):781–8.

    Article  Google Scholar 

  6. Campbell MK, Piaggio G, Elbourne DR, Altman DG. Consort 2010 statement: extension to cluster randomised trials. BMJ (Clinical research ed). 2012;345:e5661.

    Google Scholar 

  7. Piaggio G, Elbourne DR, Pocock SJ, Evans SJ, Altman DG, Group C. Reporting of noninferiority and equivalence randomized trials: extension of the CONSORT 2010 statement. JAMA. 2012;308(24):2594–604.

    Article  CAS  Google Scholar 

  8. Zwarenstein M, Treweek S, Gagnier JJ, Altman DG, Tunis S, Haynes B, et al. Improving the reporting of pragmatic trials: an extension of the CONSORT statement. BMJ (Clinical research ed). 2008;337:a2390.

    Article  Google Scholar 

  9. Vohra S, Shamseer L, Sampson M, Bukutu C, Schmid CH, Tate R, et al. CONSORT extension for reporting N-of-1 trials (CENT) 2015 Statement. BMJ (Clinical research ed). 2015;350:h1738.

    Google Scholar 

  10. Gagnier JJ, Boon H, Rochon P, Moher D, Barnes J, Bombardier C. Reporting randomized, controlled trials of herbal interventions: an elaborated CONSORT statement. Ann Intern Med. 2006;144(5):364–7.

    Article  Google Scholar 

  11. Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P. Methods and processes of the CONSORT Group: example of an extension for trials assessing nonpharmacologic treatments. Ann Intern Med. 2008;148(4):W60–6.

    Article  Google Scholar 

  12. MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, et al. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. PLoS Med. 2010;7(6):e1000261.

    Article  Google Scholar 

  13. Eldridge SM, Coleman CL, Campbell MJ, Hopewell S, Thabane L, Lancaster GA, et al. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. Pilot Feasibility Stud. 2016;2:64.

    Article  Google Scholar 

  14. Eldridge SM, Coleman CL, Campbell MJ, Hopewell S, Thabane L, Lancaster GA, et al. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. BMJ. 2016;355:i5239.

    Article  Google Scholar 

  15. Thabane L, Hopewell S, Lancaster GA, Coleman CL, Campbell MJ, Eldridge SM. Methods and processes for development of a CONSORT extension for reporting pilot randomized controlled trials. Pilot Feasibility Stud. 2016;2:25.

    Article  Google Scholar 

  16. Chan A-W, Hróbjartsson A. Promoting public access to clinical trial protocols: challenges and recommendations. Trials. 2018;19:116.

    Article  Google Scholar 

  17. Chan A-W, Song F, Vickers A, et al. Increasing value and reducing waste: addressing inaccessible research. Lancet. 2014;383(9913):257–66.

    Article  Google Scholar 

  18. Li G, et al. A systematic review of comparisons between protocols or registrations and full reports in primary biomedical research. BMC Med Res Methodol. 2018;18:9.

    Article  Google Scholar 

  19. Chan A-W, Tetzlaff JM, Altman DG, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–7.

    Article  Google Scholar 

  20. Chan A-W, Tetzlaff JM, Gøtzsche PC, et al. SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials. BMJ. 2013;346:e7586.

    Article  Google Scholar 

  21. Shamseer L. CONSORT and reporting trials in 2017: who should do what. http://blogs.biomedcentral.com/on-medicine/2017/05/19/consort-reporting-trials-2017-who-should-do-what (last accessed on 7 Feb 2019).

  22. Marchant S. Prospective publication of protocols and results of pilot and feasibility works. https://blogs.biomedcentral.com/on-medicine/announcement/prospective-publication-of-protocols-and-results-of-pilot-and-feasibility-works/ (last accessed on 7 Feb 2019).

Download references

Acknowledgements

The Working Group of the CONSORT Extension to Pilot and Feasibility Trials are Professor Sandra Eldridge and Claire Chan, Queen Mary University of London; Professor Mike Campbell, Sheffield University;Professor Gillian Lancaster, Keele University; Professor Christine Bond, Aberdeen University; and Dr. Sally Hopewell, Oxford University; and Professor Lehana Thabane, McMasters University, Canada. We are grateful to Dr. An-Wen Chan for his feedback on an earlier version of the manuscript and to Dr. Stephen Walter for editing the manuscript.

Availability of data and materials

Not applicable.

Author information

Authors and Affiliations

Authors

Contributions

LT wrote this Editorial. GL commented on and edited the drafts. Both authors approved the final version of the manuscript.

Corresponding author

Correspondence to Lehana Thabane.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

Gillian Lancaster and Lehana Thabane are co-Editors-in-Chief of Pilot and Feasibility Studies.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Thabane, L., Lancaster, G. A guide to the reporting of protocols of pilot and feasibility trials. Pilot Feasibility Stud 5, 37 (2019). https://doi.org/10.1186/s40814-019-0423-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40814-019-0423-8