Skip to main content
Download PDF

Important considerations for feasibility studies in physical activity research involving persons with multiple sclerosis: a scoping systematic review and case study

Pilot and Feasibility Studies volume 4, Article number: 1 (2018) Cite this article

An Erratum to this article was published on 24 October 2017

This article has been updated

Abstract

Background

Much research has been undertaken to establish the important benefits of physical activity in persons with multiple sclerosis (MS). There is disagreement regarding the strength of this research, perhaps because the majority of studies on physical activity and its benefits have not undergone initial and systematic feasibility testing. We aim to address the feasibility processes that have been examined within the context of physical activity interventions in MS.

Method

A systematic scoping review was conducted based on a literature search of five databases to identify feasibility processes described in preliminary studies of physical activity in MS. We read and extracted methodology from each study based on the following feasibility metrics: process (e.g. recruitment), resource (e.g. monetary costs), management (e.g. personnel time requirements) and scientific outcomes (e.g. clinical/participant reported outcome measures). We illustrate the use of the four feasibility metrics within a randomised controlled trial of a home-based exercise intervention in persons with MS.

Results

Twenty-five studies were identified. Resource feasibility (e.g. time and resources) and scientific outcomes feasibility (e.g. clinical outcomes) methodologies were applied and described in many studies; however, these metrics have not been systematically addressed. Metrics related to process feasibility (e.g. recruitment) and management feasibility (e.g. human and data management) are not well described within the literature. Our case study successfully enabled us to address the four feasibility metrics, and we provide new information on management feasibility (i.e. estimate data completeness and estimate data entry) and scientific outcomes feasibility (i.e. determining data collection materials appropriateness).

Conclusion

Our review highlights the existing research and provides a case study which assesses important metrics of study feasibility. This review serves as a clarion call for feasibility trials that will substantially strengthen the foundation of research on exercise in MS.

Peer Review reports

Background

Multiple sclerosis (MS) is a disease of the central nervous system characterised by inflammation, axonal demyelination and transection and neurodegeneration. The damage and its location within the CNS [1, 2] manifest as a loss of physical and psychological function, worsening of symptoms and reduction in quality of life (QOL). Over the past 20 years, there have been an increasing number of randomised controlled trials (RCTs) of exercise as a therapeutic intervention for managing the consequences of MS. There is substantial evidence from these RCTs for short-term benefits of exercise and physical activity amongst persons with MS who have mild-to-moderate disability [3–5]. Exercise is now considered one of the most important interventions for inclusion in the management of MS and its consequences [6].

Importantly, there is ongoing debate about the strength of the existing research regarding exercise and MS (e.g. [7] vs. [8]), and this is associated with limitations of previous RCTs. For example, there is limited evidence for the duration of benefits from participation in the exercise intervention after cessation of the intervention period [9–11]. Some data suggest that the benefits of exercise are not retained following cessation of an exercise programme [12]. The degree of benefits might depend on complying with the prescribed intervention [13], yet some exercise intervention studies report attrition rates of up to 42% [14]. There is substantial evidence indicating that persons with MS are not engaging in sufficient amounts of physical activity for accruing health benefits; this questions the broad translation of exercise benefits amongst persons with MS. The loss of benefits after cessation of exercise interventions and the poor uptake of physical activity amongst persons with MS is a public health concern and might be associated with the “bedrock” of previous research.

We believe that one major limitation of previous research that ultimately undermines efficacy, effectiveness and translation is that the majority of studies on physical activity and its benefits have not undergone initial and systematic feasibility testing (i.e. of the processes, resources, management and scientific outcomes of clinical trials). Instead, previous pilot studies have been undertaken in controlled environments (e.g. laboratory settings) to primarily demonstrate efficacy, but may not translate to or achieve real life effectiveness for continued, long-term uptake of physical activity [15]. They may have poor compliance with the intervention itself. This lack of systematic feasibility testing may result in the main study not achieving efficacy or effectiveness for changing the target outcome. This means that researchers may not be conducting the preliminary work that informs the design and implementation of an intervention before examining if the intervention has an effect on an outcome of interest. Essentially, we are forgoing building a strong and stable foundation that supports a robust framework and scaffolding for our house; without such a foundation, we might have a house of cards!

There is growing acceptance and recognition of the importance of conducting and reporting preliminary work on the feasibility of a study. Feasibility studies might be considered similar to phase 1 or phase 2 evaluation (or “proof of concept”) of pharmacological interventions [16]. However, it is acknowledged that interventions involving behavioural or lifestyle interventions (e.g. physical activity) may not fit into the classical clinical trial developmental model [17] (i.e. phase 1, evaluation of intervention safety, safe dosage range and identify side effects; phase 2, evaluation of whether the intervention is effective; phase 3, confirmation of intervention effectiveness, monitoring of side effects, comparison with common alternative treatments and safety; phase 4, after market evaluation of the intervention’s effect in various populations and determination of side effects associated with long-term use [17]).

Feasibility is “an overarching concept for studies assessing whether a future study, project or development can be done” [18], and investigators attempt to answer a question about whether some element of the main study can and/or should be done, and, if so, how it could/should be done [16]. Pilot studies fit within the framework of feasibility [18], and investigators attempt to answer similar questions to a feasibility study and extend this to include a smaller scale version of the future study (i.e. a randomised or non-randomised trial). Feasibility studies of behavioural or lifestyle interventions (e.g. physical activity) fit within the stages of the updated National Institute of Health’s conceptual framework of intervention development [19], and these stages are outlined below and referred to in Fig. 1;

Fig. 1
figure 1

Relationship between feasibility, pilot and main trials

Full size image

  • Stage 0 includes the basic science of research and could include any behavioural, cognitive, affective or social or neuroscience being undertaken for development of the behavioural intervention.

  • Stage I includes all activities related to the creation of a new intervention or the modification, adaption or refinement of an existing intervention. This stage includes feasibility and pilot testing.

  • Stage II includes the testing of promising behavioural interventions in research settings, with research therapists/providers.

  • Stage III includes the testing of intervention efficacy in a well-controlled, internally valid study in a community setting with community therapists/providers, and this includes community friendly fidelity monitoring and enhancement procedures as part of the intervention.

  • Stage IV includes the testing of intervention effectiveness, and it examines behavioural intervention in community settings, with community therapists/providers, and maximises external validity.

  • Stage V includes translation of the research. The translation involves implementing scientifically supported interventions into community settings and distributing intervention information and materials to the relevant groups [19].

Figure 1 contextualises the importance of feasibility studies within the larger process of developing and conducting clinical interventions. Stage I data is important to the advancement of stage II and stage III, while data from stage II to V can inform stage I for further refinement of the intervention [19]. For example, feasibility studies that target physical activity in a clinical population such as MS must consider metrics that are important for the success of future studies. These metrics provide information on if, and how, the research can be done in the first place. Further, stage I data will inform, and be informed by, the Basic Science data established in stage 0. Feasibility and pilot studies should be undertaken prior to the main stage II or stage III studies, [18], and we propose that information flow between these main stage II or stage III studies should inform alternate feasibility or pilot work; see Fig. 1. Such bidirectional informational flow will improve overall care for persons with MS and improve our understanding of clinical research in MS care.

Clinical journals are now accepting feasibility studies in recognition of the importance to the scientific field [20, 21]. Funding bodies recognise the importance of preliminary work and offer small grant programmes (e.g. the United States National Institute of Health Small Grant Program (RO3)). There are guidelines for conducting and reporting of preliminary studies [16, 22–24], and a framework has recently been proposed for defining feasibility and pilot studies [18].

Our objective is to investigate and clarify what feasibility processes have been investigated and described within the context of physical activity interventions in MS. We will undertake a systematic scoping review which will clarify the important definitions and conceptual boundaries of feasibility studies that provide context to the current position of preliminary research on this topic [25]. We provide examples of the process, resource, management and scientific metrics currently investigated in physical activity research in persons with MS and present the case that there are a number of important outcomes of feasibility that should be addressed in future research. We illustrate a case study of a pragmatic approach taken to assess the four feasibility metrics through a study of a physical activity and behavioural change intervention to increase the physical activity participation of persons with MS [26].

Methods

Our literature review was informed by past reviews of preliminary studies in clinical research [18, 20, 27, 28] and was carried out in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analysis (PRISMA) [29]. Our inclusion criteria stipulated that papers had (1) to be published between 2000 and 2016, (2) to be written in English, (3) to study persons with MS, (4) to include interventions or assessments deemed to encapsulate physical activity and (5) to be indexed as a feasibility or pilot study. Additional exclusion criteria were (6) described as large scale (e.g. stage II or stage III studies), (7) discussion or review articles, (8) cross-sectional or retrospective data, (9) data gathering protocol only and (10) abstract only, and we further required that (11) the major consideration of the study was not to scientifically explore the treatment safety, dose, response and efficacy only (i.e. the effect of the intervention on the assessed outcomes). Our literature review was not designed to capture all preliminary studies in persons with MS that include aspects of physical activity; consistent with a scoping review [25, 30], it was designed to capture an overall summary of current research in this area that involves feasibility metrics.

We searched the following databases without date limits: PubMed, Science Direct, Scopus, SPORTDiscus and Web of Science. The key terms searched involved Multiple Sclerosis, acronyms of preliminary study (e.g. Safety, Feasibility, Pilot, Preliminary, Phase 1, Stage 1) and acronyms of physical rehabilitation (e.g. Physical activity, Exercise, Rehabilitation). An example of our search strategy is provided as an Appendix.

Two reviewers read each study and determined examples of process, resource, management or scientific feasibility and used those to evoke discussion on current trends in preliminary studies involving persons with MS and that included aspects of physical activity. To ensure agreement, we used a checklist to identify examples of process, resource, management and scientific feasibility from previous reviews and discussion papers [16, 23, 27, 31, 32]. We met frequently to discuss study content and make a decision on the representation of process, resource, management or scientific feasibility.

Our four metrics of feasibility were derived from previous literature [23, 24] and are summarised in Table 1. When determining inclusion of process feasibility in the reviewed studies, we were interested in reporting of the processes that were keys to the success of the main study (i.e. where studies provided information on access to participants or ease of randomisation). For determining inclusion of resource feasibility in the reviewed studies, we were interested in reporting of the time and resource problems that may occur during the main study (i.e. participant retention, appropriateness of eligibility criteria, participation barriers, participant compliance with protocols, participant reaction to outcome assessment, equipment access and cost, intervention suitability within the proposed setting, staff training needs). For determining inclusion of management feasibility in the reviewed studies, we were interested in examining reporting of potential human and data management problems (i.e. research site capacity, equipment usage, data processing time, data completeness, data entry, software appropriateness, auditing of intervention delivery and ongoing ease of randomisation). For determining inclusion of scientific feasibility in the reviewed studies, we were interested in examining reporting of the safety, dose and response of the study to identify the appropriate intervention and assessment outcome. Examples of these include challenges noted by study personnel, appropriateness of data collection materials, potential threats to study validity, participant acceptance of the intervention, participant tolerance to the protocol, potential participant bias, data variability, treatment effect, consistency of results to expectations and appropriateness of participant group for receiving the intervention.

Table 1 Rationale for conducting a pilot/feasibility study
Full size table

We initially planned to exclude all pilot studies that primarily reported upon the scientific outcome of treatment effect of studies, but, during our review, we established that other feasibility metrics were investigated in pilot studies, and we therefore chose to not exclude the studies.

Case study

Our literature review highlighted a need to design a pragmatic study to address feasibility in exercise-based physical activity research within an MS population. We designed a study entitled Guidelines for Exercise in Multiple Sclerosis (GEMS), and this represents our pragmatic case study. The GEMS project [26, 33] is part of a larger research agenda to understand and improve exercise behaviour in persons with MS and received ethical approval from a Midwest, USA University ethical review board. The randomised controlled study examined the feasibility of a 4-month home-based exercise training programme designed based on recent physical activity guidelines for MS and supplemented by behavioural strategies (e.g. video coaching calls) for compliance. The study was undertaken from summer 2015 until spring 2016, and we published our study design and methods for the project [26] and results of the study [33]. Overall, the study was a 4-month home-based exercise training programme designed based on recent physical activity guidelines for MS and supplemented by behavioural strategies for compliance. Participants with mild-to-moderate MS were recruited and randomised into an intervention or wait-list control condition. Intervention participants received exercise equipment and received compliance materials and coaching calls. All participants completed relevant validated outcomes (e.g. exercise participation). Intervention participants provided feedback following the intervention via a written feedback survey and telephone interview.

We established clear data sources and outcome variables to assess each feasibility metric. Full details of all monitoring and assessment strategies, data source and outcome variables for areas of process, resource, management and scientific feasibility can be assessed in our publications [26, 33].

Results

Our literature search identified 205 studies (Fig. 2), and 82 were duplicates across search engines. We initially excluded 100 studies for the following reasons: described as large scale (i.e. stage II or stage II studies) (n = 4), discussion or review papers (n = 21), cross-sectional (n = 2) or retrospective (n = 2) studies; not inclusive of persons with MS (n = 4); did not included aspects of physical activity (n = 33); were data gathering protocols (n = 4); were abstracts only (n = 26); did not use the terms “feasibility” or “pilot” in the article title, abstract or keywords (n = 2) and were not written in English (n = 2). Two articles initially excluded due to not including the terms pilot or feasibility were reconsidered as these were secondary publications of a feasibility study.

Fig. 2
figure 2

PRISMA flow chart of literature search

Full size image

There were 25 studies deemed of interest to inform the current status quo of preliminary physical activity studies in MS population. We read these studies and undertook a content analysis focused on our four feasibility metrics of interest, process, resource, management and scientific feasibility. Table 1 provides a summary of the four feasibility metrics, data which can be established during feasibility studies and examples of outcomes used to gather data. Table 1 further provides the detailed results of our feasibility case study.

Of the 25 articles, 21 included an intervention [7, 34–53], 1 compared recruitment methods into an intervention study [53] and 1 was a cost analysis of the same intervention study [54]. One study was an investigation into the feasibility of an outcome assessment [55], and one was a qualitative analysis of participant opinions following an intervention [56].

The words feasibility and pilot were used in the title of 6 [35, 37, 47, 48, 51, 52] and 8 [7, 34, 39–42, 44, 51] studies, respectively, and 23 [7, 35–54, 57] studies indexed the word feasibility in the abstract, and 7 [7, 35, 40–43, 48] studies included pilot in the abstract. One [35] study included feasibility in the key words, and one [52] study included pilot in the key words.

The reporting mechanism and a summary of results for each of the four feasibility domains are detailed in Table 1. We identified that aspects of process feasibility were included in 10 studies, aspects of resource feasibility were discussed in 21 studies, aspects of management feasibility were included in 4 studies and aspects of scientific outcome feasibility were included in 16 studies. Within our discussion of how past studies assessed the four feasibility domains, we further provided abbreviated results for these domains as assessed in our case study, Project GEMS [33].

Process feasibility

Practical aspects of recruiting participants were reported in 9 studies [7, 41, 44–46, 48, 52, 53, 55]; in the one study that compared recruitment strategies, researcher established that MS clinic recruitment (compared with consultant referral and trial awareness) was successful. In the Project GEMS case study, we took a successive recruitment approach (i.e. postal, email and then telephone invitation) to yield a 52% recruitment rate. No study discussed the willingness of participants to be randomised to either the main intervention group or the comparison group, and we did not include this aspect in our case study.

Resource feasibility

The retention of participants in the studies was reported in 17 studies [7, 35, 37–40, 43–48, 50–52, 55, 58], and some studies discussed participant attrition. Reasons for study attrition included the following: aspects of the intervention, changes in time commitments, unable to travel, MS relapse, other medical issues, non-compliance with the study protocol and lost contact [35, 37, 45]. In our case study, we reported high numbers of participants completing Project GEMS and identified that changes in time commitment and other medical issues resulted in participant attrition. Eligibility criteria were reported in 7 studies [7, 35, 41, 42, 44, 47, 48, 55], and reasons for not meeting the eligibility criteria included the following: potential participants were too active, too old, had a recent relapse, were participating in another trial, were participating in formal rehabilitation, had a non-MS diagnosis, had recent change in disease modifying therapy, had a high fall history and had cognitive deficits. In Project GEMS, potential participants were excluded due to being too active or having a disability level lower than our criteria. To estimate barriers to participation, data on retention were considered in 8 studies [7, 35, 43, 45, 46, 51, 52, 58], and barriers included are being unable to travel, unable to commit time, MS relapse and other medical issues. In Project GEMS, the only identified barrier to participation was from potential participants unable to commit time. Compliance with the intervention was demonstrated in 13 studies via participant attendance at intervention sessions [35, 37–40, 42–47, 50, 52, 58], and in our case study, we also reported compliance via the number of completed exercise sessions. Participants reaction to outcome assessments were identified in 2 studies [49, 56], and issues identified included participants being unable to complete walking-based outcome assessments. In Project GEMS, we determined participant reaction to outcome assessment via the time it took for completion of the outcome assessments, and we gathered feedback comments from participants on the topic of completing outcome assessments. One reviewed study identified study costs based upon staff, equipment and facility overheads. In project GEMS, we calculated cost based upon research overheads and participants remuneration. The intervention suitability was determined in 3 studies using staff and participant interviews [42, 44, 55], and we used similar methodology in Project GEMS. In Project GEMS, positive feedback responses indicated that the intervention was suitable. Aspects related to clinician training need and competence were identified in 3 studies [42, 44, 55], and we did not include this aspect in our own study.

Management feasibility

Research site capacity was identified in 1 study [53], and this was through the length of time staff devoted to recruiting participants to the study. In our case study, we reported staff time requirements. One study established data on equipment usage [55], and this was by identifying problems with the data collection equipment; we did not assess this metric in Project GEMS. One study identified processing time for data collection and preparation [51], and in Project GEMS, we assessed this metric using the mail turn-around-time for us to receive outcome assessments back from participants. We could not identify any past study which provided examples of data completeness. In Project GEMS, we did assess this metric and we did so via the percentage of missing data. Similarly, we could not identify any past study which estimated data entry, and in Project GEMS, we assessed this metric by identifying the time for staff to enter and check data. One study identified software appropriateness for data entry [55], and another study used procedures to audit treatment fidelity [42]; we did not assess either of these metrics in Project GEMS,

Scientific feasibility

The challenges experienced by study personnel were reported in 1 study [49], where it was highlighted that more time was required for participants to complete assessments. We did not assess this metric as part of Project GEMS. We did not identify any past study which reported on the appropriateness of data collection materials; in Project GEMS, feedback from participants indicated that the outcome assessments (e.g., data collection materials) were burdensome. There were no examples from the literature which examined potential extraneous variables which may threaten the validity of the research, and we did not assess this metric in our study. Four studies assessed the acceptability of the intervention [35, 37, 56, 57], and this was by identifying what was the most commonly chosen form of exercise. In Project GEMS, we identified from written and verbal feedback that overall, the intervention was acceptable to all participants. Eleven randomised controlled studies estimated data variability in controlled trials [7, 41, 45–49, 58], and it was found that there were no significant differences in outcome measures at baseline. In Project GEMS, we identified no significant differences between outcome measures at baseline. Nine studies reported what the effect of the intervention was on their primary outcome measure [37, 39, 45, 46, 52, 58]; in Project GEMS, we reported the effect of the intervention on our primary outcome measure. Finally, 1 study determined the appropriateness of the target group for receiving the intervention [56], and in Project GEMS, we established that the intervention was appropriate for our written and verbal feedback.

Discussion

Our discussion of the literature highlights that important areas of feasibility are not being adequately addressed in preliminary physical activity studies in persons with MS and this has major implications for the strength of the existing research regarding exercise and MS. We believe this might be addressed in future research through the provision of this scoping review of the literature. For example, process feasibility (e.g. recruitment) was discussed in less than half of the studies, and there is a need for more information on participant reactions to randomisation; it is not clear whether randomisation during clinical trials affects recruitment rates and how this might inform trial design (e.g. preference designs vs. RCTs). Metrics related to resources (e.g. time and resources) were explored in many studies, and this suggests that researchers are efficient at reporting these methodological areas. However, there is still a need for clarification of some aspects; for example, we do not know the costs involved in undertaking physical activity research programmes and these data are essential for both realistic application to funding bodies and the application of the intervention in everyday clinical practice. Data on management feasibility are not well reported in the included literature; without these data, replication of research studies and application of the intervention in clinical practice may be carried out in lieu of full knowledge regarding staffing and infrastructural requirements, and this may ultimately lead to failure of the intervention. Finally, there are many important aspects of scientific outcome feasibility, which require further explanation in preliminary studies, the reporting of intervention problems, and participant feedback will arm researchers with important knowledge to improve the science of physical activity interventions for persons with MS. There was a limitation of some studies to report hypothesis testing for baseline comparisons and the direct calculation of treatment effects, however these areas are not recommended in the new CONSORT extension guidelines [16].

Our case study, Projects GEMS, enabled us to systematically record feasibility study in the domains of process (e.g. recruitment), resource (e.g. communication with participants), management (e.g. missing data items) and scientific outcomes (e.g. compliance during the intervention and participant feedback). This approach allowed us to record challenges to the design, methods and procedures of the study. We designed the GEMS project to be consistent with guidelines for the conduction and reporting of preliminary studies [22–24]; however, we acknowledge that not all aspects of feasibility study were assessed during the GEMS project. Importantly, there are areas of feasibility such as determining ease of randomisation and providing details of variables which may threaten the validity of the research which are still to be discussed in the physical activity in persons with MS literature. We encourage researchers to monitor the four domains of feasibility when first designing behavioural interventions in persons with MS and to use these strong foundations to build improved interventions and better current research design.

Conclusions

The strength of the evidence indicating that exercise is beneficial for persons with MS is growing; however, the evidence is not yet unequivocal as there are some examples of exercise interventions being ineffective in improving the primary outcome in comparison with a control group, e.g. [7, 59], and/or exercise behaviour, potentially, being difficult to sustain [9–11]. It is of importance that we are not yet designing high impact studies using effective and sustainable interventions, and as a result, we are not articulating the exercise message clearly to the wider MS community. We believe that this can be addressed through feasibility research, and there is lack of a systematic approach for such trials in exercise and MS. Our review highlights the existing research and our recent study, and we hope that this serves as a clarion call for feasibility trials that will substantially strengthen the foundation or bed rock of research on exercise in MS. The time is ripe, and we invite your participation on feasibility research on exercise in MS.

Change history

  • 24 October 2017

    A correction to this article has been published.

References

  1. Bjartmar C, Trapp BD. Axonal and neuronal degeneration in multiple sclerosis: mechanisms and functional consequences. Curr Opin Neurol. 2001;14(3):271–8.

    Article  CAS  PubMed  Google Scholar 

  2. Schapiro RT. Symptom management in multiple sclerosis. Ann Neurol. 1994;36(S1):S123–9.

    Article  PubMed  Google Scholar 

  3. Motl RW, Pilutti LA. The benefits of exercise training in multiple sclerosis. Nat Rev Neurol. 2012;8(9):487–97.

    Article  PubMed  Google Scholar 

  4. Motl RW. Lifestyle physical activity in persons with multiple sclerosis: the new kid on the MS block. Mult Scler J. 2014;20(8):1025–9.

    Article  Google Scholar 

  5. Pilutti LA, Greenlee TA, Motl RW, Nickrent MS, Petruzzello SJ. Effects of exercise training on fatigue in multiple sclerosis: a meta-analysis. Psychosom Med. 2013;75(6):575–80.

    Article  CAS  PubMed  Google Scholar 

  6. Vollmer T, Benedict R, Bennett S, Motl RW, White AT, Bombardier CH, et al. Exercise as prescriptive therapy in multiple sclerosis. A consensus conference white paper. Int J MS Care. 2012;14(S3):2–14.

    Google Scholar 

  7. Coote S, Hughes L, Rainsford G, Minogue C, Donnelly A. Pilot randomized trial of progressive resistance exercise augmented by neuromuscular electrical stimulation for people with multiple sclerosis who use walking aids. Arch Phys Med Rehabil. 2015;96(2):197–204.

    Article  PubMed  Google Scholar 

  8. Dalgas U, Stenager E, Sloth M, Stenager E. The effect of exercise on depressive symptoms in multiple sclerosis based on a meta-analysis and critical review of the literature. Eur J Neurol Off J Eur Fed Neurol Soc. 2015;22(3):443–e34.

    CAS  Google Scholar 

  9. Garrett M, Hogan N, Larkin A, Saunders J, Jakeman P, Coote S. Exercise in the community for people with minimal gait impairment due to MS: an assessor-blind randomized controlled trial. Mult Scler J. 2013;19(6):782–9.

    Article  CAS  Google Scholar 

  10. McCullagh R, Fitzgerald AP, Murphy RP, Cooke G. Long-term benefits of exercising on quality of life and fatigue in multiple sclerosis patients with mild disability: a pilot study. Clin Rehabil. 2008;22(3):206–14.

    Article  PubMed  Google Scholar 

  11. van den Berg M, Dawes H, Wade DT, Newman M, Burridge J, Izadi H, et al. Treadmill training for individuals with multiple sclerosis: a pilot randomised trial. J Neurol Neurosurg Psychiatry. 2006;77(4):531–3.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Collett J, Dawes H, Meaney A, Sackley C, Barker K, Wade D, et al. Exercise for multiple sclerosis: a single-blind randomized trial comparing three exercise intensities. Mult Scler Houndmills Basingstoke Engl. 2011;17(5):594–603.

    Article  Google Scholar 

  13. Adamson BC, Ensari I, Motl RW. The effect of exercise on depressive symptoms in adults with neurological disorders: a systematic review and meta-analysis. Arch Phys Med Rehabil. 2015;96(7):1329–38.

    Article  PubMed  Google Scholar 

  14. Rampello A, Franceschini M, Piepoli M, Antenucci R, Lenti G, Olivieri D, et al. Effect of aerobic training on walking capacity and maximal exercise tolerance in patients with multiple sclerosis: a randomized crossover controlled study. Phys Ther. 2007;87(5):545–59.

    Article  PubMed  Google Scholar 

  15. Pilutti LA, Platta ME, Motl RW, Latimer-Cheung AE. The safety of exercise training in multiple sclerosis: a systematic review. J Neurol Sci. 2014;343(1–2):3–7.

    Article  PubMed  Google Scholar 

  16. Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, et al. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. BMJ. 2016;355:i5239.

    Article  PubMed  PubMed Central  Google Scholar 

  17. Friedman LM, Furberg CD, DeMets D. Fundamentals of clinical trials. 4th ed. New York: Springer; 2010.

    Book  Google Scholar 

  18. Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, et al. Defining feasibility and pilot studies in preparation for randomised controlled trials: development of a conceptual framework. PLoS ONE. 2016;11(3):e0150205.

  19. Onken LS, Carroll KM, Shoham V, Cuthbert BN, Riddle M. Reenvisioning clinical science: unifying the discipline to improve the public health. Clin Psychol Sci J Assoc Psychol Sci. 2014;2(1):22–34.

    Article  Google Scholar 

  20. Arain M, Campbell MJ, Cooper CL, Lancaster GA. What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Med Res Methodol. 2010;10:67.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Lancaster G a. Pilot and feasibility studies come of age! Pilot Feasibility Stud. 2015;1(1):1.

  22. Craig P, Dieppe P, Macintyre S, Michie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.

    Article  PubMed  PubMed Central  Google Scholar 

  23. Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10:1.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Tickle-Degnen L. Nuts and bolts of conducting feasibility studies. Am J Occup Ther Off Publ Am Occup Ther Assoc. 2013;67(2):171–6.

    Article  Google Scholar 

  25. Peters MDJ, Godfrey CM, Khalil H, McInerney P, Parker D, Soares CB. Guidance for conducting systematic scoping reviews. Int J Evid Based Healthc. 2015;13(3):141–6.

    Article  PubMed  Google Scholar 

  26. Adamson BC, Learmonth YC, Kinnett-Hopkins D, Bohri M, Motl RW. Feasibility study design and methods for Project GEMS: Guidelines for Exercise in Multiple Sclerosis. Contemp Clin Trials. 2016;47:32–9.

    Article  PubMed  Google Scholar 

  27. Lancaster GA, Dodd S, Williamson PR. Design and analysis of pilot studies: recommendations for good practice. J Eval Clin Pract. 2004;10(2):307–12.

    Article  PubMed  Google Scholar 

  28. Shanyinde M, Pickering RM, Weatherall M. Questions asked and answered in pilot and feasibility randomized controlled trials. BMC Med Res Methodol. 2011;11(1):117.

    Article  PubMed  PubMed Central  Google Scholar 

  29. Moher D, Liberati A, Tetzlaff J, Altman DG, The PRISMA Group. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement. PLoS Med. 2009;151(4):e1000097.

    Article  Google Scholar 

  30. Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005;8(1):19–32.

    Article  Google Scholar 

  31. Abbott JH. The distinction between randomized clinical trials (RCTs) and preliminary feasibility and pilot studies: what they are and are not. J Orthop Sports Phys Ther. 2014;44(8):555–8.

    Article  PubMed  Google Scholar 

  32. McGrath JM. Not all studies with small samples are pilot studies. J Perinat Neonatal Nurs. 2013;27(4):281–3.

    Article  PubMed  Google Scholar 

  33. Learmonth YC, Adamson BC, Kinnett-Hopkins D, Bohri M, Motl RW. Results of a feasibility randomised controlled study of the Guidelines for Exercise in Multiple Sclerosis Project. Contemp Clin Trials. 2016;54:84–7.

    Article  PubMed  Google Scholar 

  34. Benedetti MG, Gasparroni V, Stecchi S, Zilioli R, Straudi S, Piperno R. Treadmill exercise in early mutiple sclerosis: a case series study. Eur J Phys Rehabil Med. 2009;45(1):53–9.

    CAS  PubMed  Google Scholar 

  35. Carter AM, Daley AJ, Kesterton SW, Woodroofe NM, Saxton JM, Sharrack B. Pragmatic exercise intervention in people with mild to moderate multiple sclerosis: a randomised controlled feasibility study. Contemp Clin Trials. 2013;35(2):40–7.

    Article  PubMed  Google Scholar 

  36. Fornusek C, Hoang P. Neuromuscular electrical stimulation cycling exercise for persons with advanced multiple sclerosis. J Rehabil Med. 2014;46(7):698–702.

    Article  PubMed  Google Scholar 

  37. Hale LA, Mulligan HF, Treharne GJ, Smith CM. The feasibility and short-term benefits of Blue Prescription: a novel intervention to enable physical activity for people with multiple sclerosis. Disabil Rehabil. 2013;35(14):1213–20.

    Article  CAS  PubMed  Google Scholar 

  38. Jackson K, Edginton-Bigelow K, Bowsheir C, Weston M, Grant E. Feasibility and effects of a group kickboxing program for individuals with multiple sclerosis: a pilot report. J Bodyw Mov Ther. 2012;16(1):7–13.

    Article  PubMed  Google Scholar 

  39. Jackson K, Edginton-Bigelow K, Cooper C, Merriman H. A group kickboxing program for balance, mobility, and quality of life in individuals with multiple sclerosis: a pilot study. J Neurol Phys Ther. 2012;36(3):131–7.

    Article  PubMed  Google Scholar 

  40. Mandelbaum R, Triche EW, Fasoli SE, Lo AC. A pilot study: examining the effects and tolerability of structured dance intervention for individuals with multiple sclerosis. Disabil Rehabil. 2016;38(3):218–22.

    Article  PubMed  Google Scholar 

  41. Plow M, Bethoux F, McDaniel C, McGlynn M, Marcus B. Randomized controlled pilot study of customized pamphlets to promote physical activity and symptom self-management in women with multiple sclerosis. Clin Rehabil. 2014;28(2):139–48.

    Article  PubMed  Google Scholar 

  42. Salbach NM, Howe J-A, Brunton K, Salisbury K, Bodiam L. Partnering to increase access to community exercise programs for people with stroke, acquired brain injury, and multiple sclerosis. J Phys Act Health. 2014;11(4):838–45.

    Article  PubMed  Google Scholar 

  43. Salem Y, Scott AH, Karpatkin H, Concert G, Haller L, Kaminsky E, et al. Community-based group aquatic programme for individuals with multiple sclerosis: a pilot study. Disabil Rehabil. 2011;33(9):720–8.

    Article  PubMed  Google Scholar 

  44. Smith DC, Lanesskog D, Cleeland L, Motl R, Weikert M, Dlugonski D. Motivational interviewing may improve exercise experience for people with multiple sclerosis: A small randomized trial. Health Soc Work. 2012;37(2):99–109.

    Article  PubMed  Google Scholar 

  45. Sosnoff JJ, Moon Y, Wajda DA, Finlayson ML, McAuley E, Peterson EW, et al. Fall risk and incidence reduction in high risk individuals with multiple sclerosis: a pilot randomized control trial. Clin Rehabil. 2015;29(10):952–60.

    Article  PubMed  Google Scholar 

  46. Sosnoff JJ, Balantrapu S, Moon Y, Sandroff BM, Pilutti LA, Fanning J, et al. Home based exercise program and fall risk reduction in older adults with MS. 2014;28(3):254–63.

  47. Straudi S, Martinuzzi C, Pavarelli C, Sabbagh Charabati A, Benedetti MG, Foti C, et al. A task-oriented circuit training in multiple sclerosis: a feasibility study. BMC Neurol. 2014;14:124.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Uszynski MK, Purtill H, Donnelly A, Coote S. Comparing the effects of whole-body vibration to standard exercise in ambulatory people with Multiple Sclerosis: a randomised controlled feasibility study. Clin Rehabil. 2016;30(7):657–68.

    Article  PubMed  Google Scholar 

  49. Kersten P, McPherson KM, Kayes NM, Theadom A, McCambridge A. Bridging the goal intention-action gap in rehabilitation: a study of if-then implementation intentions in neurorehabilitation. Disabil Rehabil. 2015;37(12):1073–81.

    Article  PubMed  Google Scholar 

  50. Peruzzi A, Cereatti A, Della Croce U, Mirelman A. Effects of a virtual reality and treadmill training on gait of subjects with multiple sclerosis: a pilot study. Mult Scler Relat Disord. 2016;5:91–6.

    Article  PubMed  Google Scholar 

  51. Swank C, Thompson M, Medley A. Aerobic Exercise in People with Multiple Sclerosis: Its Feasibility and Secondary Benefits. Int J MS Care. 2013;15(3):138–45.

    Article  PubMed  PubMed Central  Google Scholar 

  52. van der Linden ML, Bulley C, Geneen LJ, Hooper JE, Cowan P, Mercer TH. Pilates for people with multiple sclerosis who use a wheelchair: feasibility, efficacy and participant experiences. Disabil Rehabil. 2014;13(11):932–9.

    Article  Google Scholar 

  53. Carter A, Humphreys L, Snowdon N, Sharrack B, Daley A, Petty J, et al. Participant recruitment into a randomised controlled trial of exercise therapy for people with multiple sclerosis. Trials. 2015;16:468.

    Article  PubMed  PubMed Central  Google Scholar 

  54. Tosh J, Dixon S, Carter A, Daley A, Petty J, Roalfe A, et al. Cost effectiveness of a pragmatic exercise intervention (EXIMS) for people with multiple sclerosis: economic evaluation of a randomised controlled trial. Mult Scler J. 2014;20(8):1123–30.

    Article  CAS  Google Scholar 

  55. Kayes NM, Schluter PJ, McPherson KM, Leete M, Mawston G, Taylor D. Exploring actical accelerometers as an objective measure of physical activity in people with multiple sclerosis. Arch Phys Med Rehabil. 2009;90(4):594–601.

    Article  PubMed  Google Scholar 

  56. Smith CM, Hale LA, Mulligan HF, Treharne GJ. Participant perceptions of a novel physiotherapy approach (“Blue Prescription”) for increasing levels of physical activity in people with multiple sclerosis: a qualitative study following intervention. Disabil Rehabil. 2013;35(14):1174–81.

    Article  PubMed  Google Scholar 

  57. Kersten S, Mahli M, Drosselmeyer J, et al. A Pilot Study of an Exercise-Based Patient Education Program in People with Multiple Sclerosis. Mult Scler Int. 2014. Epub

  58. Beer S, Aschbacher B, Manoglou D, Gamper E, Kool J, Kesselring J. Robot-assisted gait training in multiple sclerosis: a pilot randomized trial. Mult Scler Houndmills Basingstoke Engl. 2008;14(2):231–6.

    Article  CAS  Google Scholar 

  59. Dodd KJ, Taylor NF, Shields N, Prasad D, McDonald E, Gillon A. Progressive resistance training did not improve walking but can improve muscle performance, quality of life and fatigue in adults with multiple sclerosis: a randomized controlled trial. Mult Scler. 2011;17(11):1362–74.

    Article  CAS  PubMed  Google Scholar 

Download references

Funding

This work was supported in part by a mentor-based post-doctoral fellowship from the National Multiple Sclerosis Society (MB 0029).

Availability of data and materials

The data generated in the case study are available by request from RWM.

Authors’ contributions

YCL and RWM conceived the study. YCL led its development and execution. YCL undertook the literature search and primarily reviewed all articles; RWM verified the literature search and the included articles. YCL drafted the manuscript and RWM reviewed it. Both authors read and approved the final manuscript.

Competing interests

The authors declare that they have no competing interests.

Consent for publication

Not applicable.

Ethics approval and consent to participate

Not applicable.

Transparency

The lead author (YCL) affirms that the manuscript is an honest, accurate and transparent account of the study being reported; that no important aspects of the study have been omitted and that there are no any discrepancies.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Author information

Authors and Affiliations

  1. Department of Psychology and Exercise Science, Murdoch University, Murdoch, WA, 6150, Australia

    Yvonne C. Learmonth

  2. School of Health Professions, University of Alabama at Birmingham, Birmingham, AL, 35294, USA

    Robert W. Motl

Authors
  1. Yvonne C. Learmonth
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robert W. Motl
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Yvonne C. Learmonth.

Additional information

A correction to this article is available online at https://doi.org/10.1186/s40814-017-0183-2.

Appendix

Appendix

Example search strategy; PubMed search

(“Safety” OR “Efficacy” OR “Feasibility” OR “Pilot”, OR “Stage 1” OR “Stage one”) AND (“Physical activity” OR “Exercise”) AND (“Multiple Sclerosis*”).

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Learmonth, Y.C., Motl, R.W. Important considerations for feasibility studies in physical activity research involving persons with multiple sclerosis: a scoping systematic review and case study. Pilot Feasibility Stud 4, 1 (2018). https://doi.org/10.1186/s40814-017-0145-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40814-017-0145-8

Keywords

  • Feasibility studies
  • Scoping review
  • Feasibility metrics
  • Case study

Pilot and Feasibility Studies

ISSN: 2055-5784