- Study Protocol
- Open Open Peer Review
Protocol for a feasibility randomised controlled trial of the use of Physical ACtivity monitors in an Exercise Referral Setting: the PACERS study
Pilot and Feasibility Studiesvolume 3, Article number: 51 (2017)
Exercise referral schemes are recommended by the National Institute for Clinical Excellence (NICE) for physical activity promotion among inactive patients with health conditions or risk factors. Whilst there is evidence for the initial effectiveness and cost-effectiveness of such schemes for increasing physical activity, evidence of long-term effects is limited. Techniques such as goal setting, self-monitoring and personalised feedback may support motivation for physical activity. Technologies such as activity monitoring devices provide an opportunity to enhance delivery of motivational techniques. This paper describes the PACERS study protocol, which aims to assess the feasibility and acceptability of implementing an activity monitor within the existing Welsh National Exercise Referral Scheme (NERS) and proposed evaluation methodology for a full-scale randomised controlled trial.
The PACERS study consists of a pilot randomised controlled trial, process evaluation and exploratory economic analyses. Participants will be recruited from the generic pathway of the Welsh NERS and will be randomly assigned to receive the intervention or usual practice. Usual practice is a 16-week structured exercise programme; the intervention consists of an accelerometry-based activity monitor (MyWellnessKey) and an associated web platform (MyWellnessCloud). The primary outcomes are predefined progression criteria assessing the acceptability and feasibility of the intervention and feasibility of the proposed evaluation methodology. Postal questionnaires will be completed at baseline (time 0: T0), 16 weeks after T0 (T1) and 12 months after T0 (T2). Routinely collected data will also be accessed at the same time points. A sub-sample of intervention participants and exercise referral staff will be interviewed following initiation of intervention delivery and at the end of the study.
The PACERS study seeks to assess the feasibility of adding a novel motivational component to an existing effective intervention in order to enhance effects on physical activity and support longer-term maintenance. The study will provide insight into the acceptability of activity-monitoring technologies to an exercise referral population and delivery staff. Data from this study will be used to determine whether and how to proceed to a full-scale trial of effectiveness of the intervention, including any necessary refinements to intervention implementation or the proposed evaluation methodology.
Physical inactivity is a major cause of preventable illness with large costs to the National Health Service (NHS) . Increasing activity at the population level and among at-risk groups is a public health priority [2, 3]. Physical activity interventions for at-risk groups often involve advice and/or signposting from primary care practitioners . Exercise referral schemes (ERS) are one common model , usually involving referral to a community-based structured exercise programme. In Wales, the 16-week National Exercise Referral Scheme (NERS) has been running since 2007. A previous effectiveness study of the scheme  showed that, at 12 months, NERS was associated with improvements in physical activity for patients at risk of coronary heart disease, but not for those referred for anxiety and depression, despite an improvement in their mental health . The evaluation also showed the base-case incremental cost-effectiveness ratio was £12,111 per quality-adjusted life year (QALY), falling to £9741 if participants were to contribute £2 per session . Qualitative data highlighted a need for post-intervention motivational support to maintain changes [7, 8]. Whilst there is evidence for effectiveness of ERS in increasing physical activity in the short term [9,10,11], evidence of long-term effects is limited. The Department of Health’s Quality Assurance Framework for Exercise Referral  highlights the need to understand how to support long-term maintenance of changes in physical activity.
On entry to an ERS, patients may be initially motivated by external sources such as GP advice to attend [13, 14]. However, sustained changes in physical activity are consistently associated with more internalised, or autonomous, motivation [15,16,17]. According to self-determination theory , the development of autonomous motivation can be achieved through supporting psychological needs for autonomy (volitional and self-endorsed engagement), competence (personal mastery and effectiveness) and relatedness (meaningful interpersonal connections). Thus, developing ways to support these three needs should help to maintain changes in physical activity. Support for this notion is provided by the randomised controlled trial of the Welsh NERS which found increases in autonomous motivation after scheme exit. This increase explained almost half of the between-group difference in physical activity 6 months later . Integrating processes to further enhance and sustain autonomous motivation during and after involvement in an exercise referral scheme may lead to larger effects and longer-term maintenance of these. Existing evidence points to potential motivational effects of techniques such as goal setting, monitoring and personalised feedback on progress towards goals [20, 21] which may support autonomous motivation by enhancing patients’ sense of mastery and competence and are recommended by NICE as core components of behaviour change interventions .
Technologies such as activity monitors provide opportunities to enhance delivery of goal setting and feedback, allowing for more frequent and automatic feedback on progress towards activity goals, tailored updating of goals based on achievement and remote contact with intervention providers . In addition to addressing psychological needs for competence, incorporation of social components may support motivation through promoting relatedness to other service users. Research on such technologies in exercise interventions suggests that use can be quickly integrated in participants’ lives  and may increase physical activity levels [25,26,27,28,29]; however, overall, the evidence is equivocal . Furthermore, little is known about the acceptability of these technologies to ERS populations or if the benefits will remain once the initial novelty has ceased. Exercise referral patients are a diverse group with a range of ages and conditions. For example, although the average age of participants in the evaluation of the Welsh NERS was 52 years old, the overall ages ranged from 16 to 88. Thus, familiarity with technology and willingness to use it may differ within the group . In addition, participant diversity in terms of socioeconomic status and geographic location may result in differences in access to high-speed internet connections or the hardware required for engaging with some technologies (e.g. personal computer). Hence, prior to a trial of effectiveness, which may be undermined by difficulties integrating technologies into routine practice or facilitating uptake by patients, piloting is required to investigate these issues.
A preliminary investigation  tested a protocol for integrating activity monitoring devices (MyWellnessKey, Technogym) and a linked web platform in one local authority area of the Welsh NERS. The study showed potential for using the MyWellnessKey (MWK) devices in the scheme; however, further work is required to understand the feasibility and acceptability of this on a larger scale with a demographically diverse population. In this paper, we describe the protocol of the PACERS study, a pilot trial to assess the feasibility and acceptability of using the MWK activity monitors to promote maintenance of physical activity within NERS. The aim of the study is to evaluate the feasibility and acceptability of the intervention (the MWK) and its proposed evaluation methodology, in order to optimise design and delivery and evaluate whether a full-scale randomised controlled trial of effectiveness is warranted and feasible.
The primary aim of the study is to assess the feasibility and acceptability of implementing the MWK activity monitors within the Welsh NERS as well as the proposed evaluation methodology in order to optimise design and delivery for conducting a definitive evaluation trial.
The main objectives for this study are to investigate:
the fidelity of delivery of the intervention and trial methodology including compliance with study invitation and randomisation processes;
the acceptability of the intervention to participants in terms of its usability and likelihood of future use;
whether randomisation is acceptable to 50% or more of participants;
the feasibility of recruiting 20% or more new NERS patients and retaining at least 80% of participants at 12-month follow-up (T2);
contamination, by exploring whether less than 20% of control participants are exposed to the intervention;
the effect of the intervention on the main hypothesised change mechanism (autonomous motivation); and
the feasibility of collecting the primary, secondary and process outcome measures and economic evaluation methods.
The study design is an individually randomised pilot randomised controlled trial, plus a process evaluation and exploratory economic analyses, of implementing the MWK devices within Welsh NERS standard practice. Data will be collected at three time points: baseline (time 0 (T0)), at the end of the 16-week NERS programme (T1) and 12-months post-baseline (T2). Figure 1 shows the study flow diagram. The study was given favourable ethical opinion for conduct in the NHS on 1 December 2015 by the South East Scotland Research Ethics Committee 02 (REF: 189587).
Setting and participants
The study is being undertaken within the Welsh NERS across leisure centres in eight local authority areas in Wales, UK. The eight study sites were purposively selected to reflect a range of urbanisation and geography. Participants are eligible for the study if they (i) are referred into the NERS generic pathway (see Table 1) and (ii) have the capacity to use the activity monitors (i.e. computer access and an email address).
Participants will be recruited to the trial using opportunistic invites within the existing scheme structure. NERS exercise professionals will provide information about the study to all new generic pathway clients during their first consultation appointment on the scheme. Exercise professionals will transfer the contact details of clients who are eligible for and interested in joining the study to the research team using a secure electronic form. The research team will send a recruitment pack containing full informed consent materials and the baseline questionnaire to interested clients to be returned by post. Participants who return a signed consent form and completed baseline questionnaire will be entered into randomisation. Participants in the intervention group will be sent information about the process evaluation interviews following randomisation and will be asked to express an interest in taking part in the interviews. From those who express an interest, participants will be selected to provide variation in local authority area, age, sex and reason for referral. Where possible, we will interview the same participants at 4 weeks and 12 months. Where not possible, additional participants matched by demographics (e.g. age and sex) will be recruited for 12-month interviews. All NERS staff involved in the study will be invited to participate in the process evaluation interviews. From those who express an interest, two staff members per local authority area will be selected.
After completion of baseline measures, study staff will randomly assign participants 1:1 to receive either the intervention (NERS plus MWK) or the control treatment (NERS standard practice) via a computer-generated random allocation sequence created by the South East Wales Trials Unit.
The intervention is an enhanced ERS that includes usual care (NERS standard practice)  plus an accelorometry-based activity monitor (MyWellnessKey; MWK). The MWK can be used for self-monitoring of physical activity levels in combination with a linked web platform (MyWellnessCloud) and smartphone application (see Table 2). The MWK has been validated in terms of device accuracy at monitoring physical activity level and intensity [32, 33] and utility at fostering increased physical activity levels (high concurrent validity with ActiGraph accelerometer to detect physical activity in laboratory and free-living environments) .
Intervention participants will be provided with a MWK to use for the remaining 12 weeks of their 16-week NERS programme after receiving it at their 4-week consultation and will be encouraged to use it for 36 weeks after they exit the scheme, up until their 12-month consultation when the device will be returned. In current practice, conducting an 8-month telephone consultation to check clients’ progress with exercise is an optional part of standard care. To encourage participants to maintain engagement in the study, we have asked for the telephone consultation to take place with all intervention participants. Table 3 shows how the intervention will be implemented within the scheme.
It is anticipated that the intervention will enhance NERS through two key mechanisms: (1) goal setting and personalised feedback elements of the devices will support a sense of exercise mastery and perceived competence; (2) the web platform will provide a sense of relatedness to others via opportunities to communicate remotely with exercise professionals, other NERS clients and social media contacts. It is anticipated that these mechanisms will improve autonomous motivation for exercise, leading to greater maintenance of increases in physical activity, as depicted in the intervention logic model (see Fig. 2).
Control participants will receive usual care which is NERS standard practice: a 16-week structured exercise programme which includes consultations with an exercise professional at the start, 4 weeks, on exiting the scheme (16 weeks) and at 12-month follow-up .
The primary outcome will be the feasibility and acceptability of the intervention and its proposed evaluation methodology, to inform a decision on whether a full randomised controlled trial is warranted and feasible. This will be assessed against a set of predefined progression criteria related to recruitment and retention rates, exposure to the intervention in both intervention and control groups and acceptability of the intervention, recruitment and randomisation processes to participants. The criteria were agreed by the Trial Steering Committee (TSC) and follow a traffic light assessment system (red = stop; amber = discuss with TSC whether there is enough evidence that sufficient improvements can be made to proceed to full trial without another feasibility assessment; green = proceed) using quantitative measures supported by qualitative data. The criteria, their measurement and assessment criteria are summarised in Table 4. Qualitative data will provide insights into intervention and evaluation design features which need to be retained, or where metrics fall into the amber zone, modifications which may need to be made to improve feasibility and acceptability.
It is anticipated that in a full trial, the main outcome measure will be objectively measured physical activity using accelerometry. To examine the feasibility of collecting this data at follow-up in the NERS population, a sub-sample of participants will be recruited to complete the accelerometer measure at 16 months post-randomisation. Participants will wear a GT3X ActiGraph accelerometer around the waist for seven consecutive days during waking hours. Data will be processed to identify mean minutes of moderate to vigorous intensity activity per day and mean accelerometer counts per minute (volume of physical activity) using established processes .
The effect of the intervention on the main hypothesised change mechanism (autonomous motivation) will be evaluated. Other secondary outcome measures will be piloted to estimate key trial parameters (e.g. standard deviation) to inform a future full trial.
Measures collected routinely in NERS
Data collected routinely within NERS will be obtained for use within the trial from T0, T1 and T2, as follows:
Blood pressure and resting heart rate;
Body mass index;
Self-reported physical activity (Scottish Physical Activity Questionnaire) ;
Health-related quality of life (EQ-5D-5L) ; and
Fitness test (Chester fitness test) .
Measures included in PACERS study questionnaire
The following additional measures will be collected at all time points, which in a full trial would be used to assess effectiveness of the added intervention component (MyWellnessKey):
Autonomous Motivation (Behavioural Regulation in Exercise Questionnaire 3 (BREQ-3)) ;
Psychological need support (Intrinsic Motivation Inventory) ;
Anxiety and depression (Hospital Anxiety and Depression Scale (HADS)) .
Economic evaluation outcome measures
The PACERS study questionnaire will include an adapted Client Service Receipt Inventory (CSRI) based on the previous service use questionnaire used in the NERS evaluation  and examples in the DIRUM database (dirum.org) to capture client health and social care service use since the last time point (plus a 4 month retrospective period at baseline). Additional questions in the 12-month questionnaire will capture wider economic outcomes including current work status, days off work due to health problems and estimated income lost due to changes in work during the study period. Willingness to pay for the MWK will also be explored. Baseline demographic data on housing status and household income will also be collected in the PACERS study questionnaire for the purpose of the economic analysis.
The proposed sample size for the study of 286 participants was calculated to allow the estimation of the feasibility proportions of adherence and retention to within at least plus or minus 8.2 percentage points using a 95% confidence interval, as well as to provide 80% power to detect an effect size of 0.4 at the 5% level on the main hypothesised mediator of autonomous motivation at 12-month follow-up, assuming 30% attrition . The sample size was also planned to provide an indication of likely response rates, permit estimates of effect sizes of primary and secondary outcomes in advance of a larger trial and allow exploration of socio-demographic patterning in uptake and use of the MWKs in order to generate hypotheses regarding who the intervention might work for and why.
Routinely collected data will be extracted from the NERS database at all T0, T1 and T2. The PACERS study questionnaire will be mailed to participants at all time points. Telephone and email reminders will be made to non-responders. Semi-structured telephone interviews will be conducted with a sub-sample of intervention participants (n = 20) following receipt of the intervention at 4 weeks and again at 12 months (T2) to explore feasibility and acceptability of the intervention and study methods. In addition, telephone interviews will be conducted with a sample of NERS exercise professionals at the same time points to explore feasibility and acceptability of implementing the intervention and study methods from a professional perspective. Figure 3 indicates the schedule of enrolment, interventions and assessments.
A detailed process evaluation will examine the acceptability and feasibility of the intervention and evaluation methods, including intervention delivery and fidelity, potential contamination and contextual influences. Quantitative and qualitative data will be collected using a range of methods. Table 5 summarises the process evaluation methods.
Economic analysis methods
Data will be collected to estimate intervention costs and examine the feasibility of calculating cost-effectiveness alongside a definitive full pragmatic randomised trial. Health care service use will be costed using national unit costs [42, 43]. Both arms of the study with be costed, revisiting and revising the costing methodology used in previous economic analysis of the Welsh NERS .
The additional costs of the intervention will consist of the cost of the MWK; staff costs relating to the MWK (e.g. training, implementation and participant follow-up support); the cost of the professional web cloud (e.g. licence fee) and additional staff interactions. These costs are in addition to the core programme costs (in both arms) including NERS standard practice costs and participant contributions. Information about the additional staff resources required for the use of the MWK and professional web cloud will be derived from qualitative interviews with staff.
The main outcomes in this feasibility study are related to the study progression criteria as outlined in Table 4. The methods of analysis for quantitative data collected for the process evaluation are summarised in Table 5. Analyses will be largely descriptive, with summary statistics being presented overall and also by key demographics. Evidence of whether the intervention could lead to behaviour change will be examined using regression analyses to quantify effects on autonomous motivation, using the Relative Autonomy Index derived from the BREQ-3.
To examine the direction of effect on physical activity, analysis of covariance models [ANCOVA] will be used to estimate intervention effects on physical activity at 16 months. Whilst likely non-significant due to limited power, this should be in the direction of a favourable intervention effect. Accelerometer data will be processed using standard procedures; periods of ≥ 60 min of zero counts will be recorded as “non-wear time” and removed. Participants will be included in the analysis if they provide ≥ 3 valid days (i.e. 500 min of data between 6 am and 11 pm). Mean minutes of daily moderate to vigorous intensity activity will be estimated using a threshold value of ≥ 2020 counts per minute with minutes of light intensity physical activity estimated using thresholds of between 100 and 2019 counts per minute . Sedentary time will be estimated based on a cut-point of less than 100 counts per minute; mean sedentary minutes per day will be derived.
Qualitative data from interviews with exercise professionals and intervention participants will be transcribed verbatim and organised and coded into a thematic framework using NVivo 11 software. An approach to thematic analysis will be used that allows for both a deductive and inductive approach to data analysis . Data will be initially coded using an a priori coding scheme of categories which align with the research questions as a means of organising the data for subsequent interpretation. An element of flexibility will be maintained to account for the emergence of any new and unexpected themes. The first three transcripts will be independently coded by two coders in order to develop a shared codebook via consensus. Any disagreements between coders will be discussed with a third coder. Divergence and convergence between interviews will be examined and comparisons made of the experiences of the intervention across and within areas (NERS clients and exercise professionals). We aim to develop a comprehensive understanding of the intervention acceptability, implementation and mechanisms of impact.
A pilot cost-consequence analysis will be conducted from a NHS and societal perspective. Response rates and level of completion of the measures will be reported using descriptive statistics. Variables will be checked for out of range values before analysis begins. As data are expected to be skewed, non-parametric tests will be used to assess differences across groups or time points for the outcomes of QALYs (using the EQ-5D) and health and social care service use. We will bootstrap (5000 replications) differences in cost and outcomes to produce a 95% confidence interval around these differences. Ceiling effects on the EQ-5D will also be assessed, assessing the proportion of participants that state “no problems” on all five dimensions on the EQ-5D questionnaire. QALY gains (using the EQ-5D) will be compared to those in similar samples from previous literature (where available).
A report on the data gathered about service use (from routinely collected data recorded by healthcare professionals delivering NERS) will explore if future studies could use this or a different method to the CSRI questionnaire used in the feasibility study. Descriptive statistics will be used to describe the amount participants are willing to pay for the MWK, both during the intervention and beyond. Response rates and level of completion of the questions exploring how best to capture productivity losses will be reported using descriptive statistics.
Sub-group analyses will explore the effect on health-related quality of life of socio-demographics (e.g. gender) and reason for referral. Sensitivity analysis will be conducted in accordance with NICE guidelines to vary the cost of the device , demonstrating what happened in the feasibility trial and how co-ordination may be varied in a future full-scale trial.
Serious adverse event reporting and monitoring
It is not anticipated that there will be any additional risks to participants over and above existing NERS standard practice for which standard operating procedures are in place covering referral into the scheme, provision of exercise instruction and support, and dealing with adverse events. There are no serious adverse events expected to be related to the intervention. Any serious adverse event occurrence will be reported to the Chief Investigator within 48 h of receiving notification. Assignment of causality will be made by the independent clinician member of the TSC.
A Trial Management Group (TMG) is responsible for ensuring the appropriate, effective and timely implementation of the trial including monitoring adherence to standardised research protocols. The day-to-day operational management of the feasibility study is co-ordinated by a central project management team which meets weekly to monitor progress and any issues which may need relaying to the TMG. An independent TSC provides overall supervision for the trial and advice through its independent chair and also encompasses the role of Data Monitoring Committee.
The PACERS feasibility trial aims to assess the feasibility and acceptability of implementing a novel motivational component, the MyWellnessKey, into the existing Welsh NERS. In addition, the trial also aims to determine the acceptability and feasibility of the proposed evaluation methodology for a definitive trial of the intervention for promoting long-term maintenance of physical activity. Whilst exercise referral approaches have been shown to be effective for increasing physical activity levels, evidence of long-term effects is limited [9, 10, 12] and so there is a need to better understand how to support long-term maintenance of physical activity . The MWK intervention offers a potential mechanism for enhancing and sustaining autonomous motivation for physical activity via evidence-based techniques including goal setting, self-monitoring and receiving personalised feedback on progress towards goals [20,21,22].
Findings from this study will determine whether progression to a full-scale randomised controlled trial of effectiveness and cost-effectiveness is feasible and warranted, through the assessment of key progression criteria. The study will assess whether the outcomes being used are feasible and acceptable to use with the study population. Findings related to the acceptability and feasibility of implementing the intervention will inform potential refinement of the implementation processes where necessary. The findings will also allow refinement of the intervention logic model.
Client service receipt inventory
Exercise referral scheme
National Exercise Referral Scheme
National Health Service
National Institute for Clinical Excellence
National Research Ethics Service
Quality-adjusted life year
Research Ethics Committee
Trial Steering Committee
British Heart Foundation. The economic costs of physical inactivity. British Heart Foundation National Centre. Loughborough: Loughborough University: 2013.
Department of Health. Start active, stay active: a report on physical activity from the four home countries. London: Department of Health; 2011.
NICE. Exercise referral schemes to promote physical activity. London: NICE Public Health Guidance; 2014.
Din NU, Moore G, Murphy S, Wilkinson C, Williams NH. Health professionals’ perspectives on exercise referral and physical activity promotion in primary care: findings from a process evaluation of the National Exercise Referral Scheme in Wales. Health Educ J. 2014;74(6):743–57.
Sowden SL, Raine R. Running along parallel lines: how political reality impedes the evaluation of public health interventions. A case study of exercise referral schemes in England. J Epidemiol Community Health. 2008;62(9):835–41.
Murphy S, Raisanen L, Moore G, Edwards RT, Linck P, Williams N, et al. A pragmatic randomised controlled trial of the Welsh National Exercise Referral Scheme: protocol for trial and integrated economic and process evaluation. BMC Public Health. 2010;10:352.
Murphy SM, Edwards RT, Williams N, Raisanen L, Moore G, Linck P, et al. An evaluation of the effectiveness and cost effectiveness of the National Exercise Referral Scheme in Wales, UK: a randomised controlled trial of a public health policy initiative. J Epidemiol Community Health. 2012;66(8):745–53.
Moore GF, Raisanen L, Moore L, Ud Din N, Murphy SM. Mixed-method process evaluation of the Welsh National Exercise Referral Scheme. Health Educ J. 2013;113(6):476–501.
Pavey TG, Taylor AH, Fox KR, Hillsdon M, Anokye N, Campbell JL, et al. Effect of exercise referral schemes in primary care on physical activity and improving health outcomes: systematic review and meta-analysis. BMJ. 2011;343:d6462.
Campbell F, Holmes M, Everson-Hock E, Davis S, Buckley Woods H, Anokye N, et al. A systematic review and economic evaluation of exercise referral schemes in primary care: a short report. Health Technol Assess. 2015;19(60):1–110.
Williams NH, Hendry M, France B, Lewis R, Wilkinson C. Effectiveness of exercise-referral schemes to promote physical activity in adults: systematic review. Br J Gen Pract. 2007;57(545):979–86.
Department of Health. Exercise referral systems: a national quality assurance framework. London: Department of Health; 2001.
Rouse PC, Ntoumanis N, Duda JL, Jolly K, Williams GC. In the beginning: role of autonomy support on the motivation, mental health and intentions of participants entering an exercise referral scheme. Psychol Health. 2011;26(6):729–49.
Markland D, Tobin VJ. Need support and behavioural regulations for exercise among exercise referral scheme clients: the mediating role of psychological need satisfaction. Psychol Sport Exerc. 2010;11(2):91–9.
Teixeira PJ, Silva MN, Mata J, Palmeira AL, Markland D. Motivation, self-determination, and long-term weight control. Int J Behav Nutr Phys Act. 2012;9(1):1–13.
Teixeira PJ, Carraça EV, Markland D, Silva MN, Ryan RM. Exercise, physical activity, and self-determination theory: a systematic review. Int J Behav Nutr Phys Act. 2012;9(1):1–30.
Fortier MS, Wiseman E, Sweet SN, O'Sullivan TL, Blanchard CM, Sigal RJ, et al. A moderated mediation of motivation on physical activity in the context of the PAC randomized control trial. Psychol Sport Exerc. 2011;12(2):7–78.
Deci EL, Ryan RM. The ‘what’ and ‘why’ of goal pursuits: human needs and the self-determination of behavior. Psychol Inq. 2000;11(4):227–68.
Littlecott HJ, Moore GF, Moore L, Murphy S. Psychosocial mediators of change in physical activity in the Welsh national exercise referral scheme: secondary analysis of a randomised controlled trial. Int J Behav Nutr Phys Act. 2014;11(1):1–11.
O'Brien N, McDonald S, Araujo-Soares V, Lara J, Errington L, Godfrey A, et al. The features of interventions associated with long-term effectiveness of physical activity interventions in adults aged 55-70 years: a systematic review and meta-analysis. Health Psychol Rev. 2015;9(4):417–33.
Shilts MK, Horowitz M, Townsend MS. Goal setting as a strategy for dietary and physical activity behavior change: a review of the literature. Am J Health Promot. 2004;19(2):81–93.
NICE. Behaviour change: individual approaches. London: NICE Public Health Guidance; 2014. p. 49.
Petit A, Cambon L. Exploratory study of the implications of research on the use of smart connected devices for prevention: a scoping review. BMC Public Health. 2016;16:552.
Hunt K, McCann C, Gray CM, Mutrie N, Wyke S. “You’ve got to walk before you run”: positive evaluations of a walking program as part of a gender-sensitized, weight-management program delivered to men through professional football clubs. Health Psychol. 2013;32(1):57–65.
Cupples M, Dean A, Tully MA, Taggart M, McCorkell G. Using pedometer step-count goals to promote physical activity in cardiac rehabilitation: a feasibility study of a controlled trial. Int J Phys Med Rehabil. 2013;1:157.
Vaes AW, Cheung A, Atakhorrami M, Groenen MT, Amft O, Franssen FM, et al. Effect of ‘activity monitor-based’ counseling on physical activity and health-related outcomes in patients with chronic diseases: a systematic review and meta-analysis. Ann Med. 2013;45(5–6):397–412.
Davies CA, Spence JC, Vandelanotte C, Caperchione CM, Mummery WK. Meta-analysis of internet-delivered interventions to increase physical activity levels. Int J Behav Nutr Phys Act. 2012;9(1):1–13.
Kirwan M, Duncan JM, Vandelanotte C, Mummery KW. Using smartphone technology to monitor physical activity in the 10,000 steps program: a matched case control trial. J Med Internet Res. 2012;14(2):e55.
Butryn ML, Arigo D, Raggio GA, Colasanti M, Forman EM. Enhancing physical activity promotion in midlife women with technology-based self-monitoring and social connectivity: a pilot study. J Health Psychol. 2014;21(8):1548–55.
Olson KE, O’Brien MA, Rogers WA, Charness N. Diffusion of technology: frequency of use for younger and older adults. Ageing international. 2011;36(1):123–45.
Hawkins JL, Oliver EJ, Wyatt-Williams J, Scale E, van Woerden HC. Assessing the feasibility of using uniaxial accelerometers with an online support platform in the delivery of a community-based exercise referral scheme. J Prim Care Community Health. 2014;5(4):288–90.
Bergamin M, Ermolao A, Sieverdes JC, Zaccaria M, Zanuso S. Validation of the mywellness key in walking and running speeds. J Sports Sci Med. 2012;11(1):57–63.
Sieverdes JC, Wickel EE, Hand GA, Bergamin M, Moran RR, Blair SN. Reliability and validity of the Mywellness Key physical activity monitor. Clin Epidemiol. 2013;5:13–20.
Herrmann SD, Hart TL, Lee CD, Ainsworth BE. Evaluation of the MyWellness Key accelerometer. Br J Sports Med. 2011;45(2):109–13.
Troiano RP, Berrigan D, Dodd KW, Masse LC, Tilert T, McDowell M. Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc. 2008;40(1):181–8.
Lowther M, Mutrie N, Loughlan C, McFarlane C. Development of a Scottish physical activity questionnaire: a tool for use in physical activity interventions. Br J Sports Med. 1999;33(4):244–9.
The EuroQol Group. EuroQol—a new facility for the measurement of health-related quality of life. Health Policy. 1990;16(3):199–208.
Sykes K. Chester step test; resource pack (version 3). Cheshire: Chester College of Higher Education; 1998.
Markland D, Tobin V. A modification of the behavioral regulation in exercise questionnaire to include an assessment of amotivation. J Sport Exerc Psychol. 2004;26:191–6.
McAuley E, Duncan T, Tammen VV. Psychometric properties of the intrinsic motivation inventory in a competitive sport setting: a confirmatory factor analysis. Res Q Exerc Sport. 1989;60(1):48–58.
Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67(6):361–70.
Curtis L, Burns A. Unit Costs of Health and Social Care. Canterbury: Personal Social Services Research Unit; 2016.
Department of Health. NHS reference costs. London: Department of Health; 2016.
Edwards RT, Linck P, Hounsome N, Raisanen L, Williams N, Moore L, et al. Cost-effectiveness of a national exercise referral programme for primary care patients in Wales: results of a randomised controlled trial. BMC Public Health. 2013;13(1):1021.
Fereday J, Muir-Cochrane E. Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development. Int J Qual Methods. 2006;5(1):80–92.
Andronis L, Barton P, Bryan S. Sensitivity analysis in economic evaluation: an audit of NICE current practice and a review of its use and value in decision-making. Health Technol Assess. 2009;13(29):iii. ix-xi, 1-61
The authors would like to thank the following members of the Trial Steering Committee for their advice and guidance in the development of the study protocol and progression criteria: Professor Colin Greaves, Ms. Annys Randell, Dr. Nefyn Williams, Professor Monica Busse-Morris and Ms. Yvonne Sylvestre. The support of the NERS National Co-ordinator, Regional Co-ordinators, Exercise Professionals and Public Health Wales colleagues in the set up of the study and intervention is also gratefully acknowledged.
The PACERS study is funded by the Health and Care Research Wales Health Research Award (REF: HRA1019). The work was also undertaken with the support of the Centre for the Development and Evaluation of Complex Interventions for Public Health Improvement (DECIPHer), a UKCRC Public Health Research Centre of Excellence. Joint funding (MR/KO232331/1) from the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the Welsh Government and the Wellcome Trust, under the auspices of the UK Clinical Research Collaboration, is gratefully acknowledged. SS was supported by a MRC Strategic Award (MC-PC-13027, MC_UU_12017_14, & SPHSU14).
Availability of data and materials
Ethics approval and consent to participate
The PACERS study was given favourable ethical opinion for conduct in the NHS on 1 December 2015 by the South East Scotland Research Ethics Committee 02 (REF: 189587), and participants are required to provide written informed consent in order to participate in the study.
Consent for publication
Not applicable. This manuscript does not contain participant data.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
- Exercise referral
- Physical activity
- Autonomous motivation
- Feasibility studies
- Physical activity monitors
- Physical activity trackers
- Economic evaluation