- Research
- Open Access
- Published:
A feasibility study of ‘The StepSmart Challenge’ to promote physical activity in adolescents
Pilot and Feasibility Studies volume 5, Article number: 132 (2019)
Abstract
Background
Inactive lifestyles are becoming the norm and creative approaches to encourage adolescents to be more physically active are needed. Little is known about how gamification techniques can be used in physical activity interventions for young people. Such approaches may stimulate interest and encourage physical activity behaviour. The study investigated the feasibility of implementing and evaluating a physical activity intervention for adolescents which included gamification techniques within schools. We tested recruitment and retention strategies for schools and participants, the use of proposed outcome measures, and explored intervention acceptability.
Methods
This school-based feasibility study of a randomised cluster trial recruited adolescents aged 12–14 years (n = 224) from five schools (three intervention; two control) in Belfast, Northern Ireland. The 22-week intervention (The StepSmart Challenge) informed by self-determination theory and incorporating gamification strategies involved a school-based pedometer competition. Outcomes, measured at baseline, and post-intervention (at 22 weeks post-baseline and 52 weeks post-baseline) included daily minutes of moderate to vigorous physical activity (MVPA) (measured using ActiGraph accelerometer), mental wellbeing (Warwick-Edinburgh Mental Wellbeing Scale), social support for physical activity, time preference (for delayed and larger rewards or immediate and smaller rewards), pro-social behaviour (Strengths and Difficulties Questionnaire (SDQ)) and the influence of social networks. The intervention’s acceptability was explored in focus groups.
Results
We invited 14 schools to participate; eight showed interest in participating. We recruited the first five who responded; all five completed the trial. Of the 236 pupils invited, 224 participated (94.9%): 84.8% (190/224) provided valid MVPA (minutes/day) at baseline and 57.2% (123/215) at 52 weeks. All other outcomes were well completed apart from the SDQ (65% at baseline). Qualitative data highlighted that participants and teachers found The StepSmart Challenge to be an acceptable intervention.
Conclusions
The level of interest and high recruitment and retention rates provide support for the feasibility of this trial. The intervention, incorporating gamification strategies and the recruitment methods, using parental opt-out procedures, were acceptable to participants and teachers. Teachers also suggested that the implementation of The StepSmart Challenge could be embedded in a lifelong learning approach to health within the school curriculum. As young people’s lives become more intertwined with technology, the use of innovative gamified interventions could be one approach to engage and motivate health behavioural change in this population.
Trial registration
NCT02455986 (date of registration: 28 May 2015).
Background
Despite the clear benefits of physical activity, globally 80% of adolescents fall short of meeting required levels [48]. In Northern Ireland, only 14% of 11–16-year-olds are meeting the target of 60 min of daily MVPA [20]. As physical activity patterns track into adulthood [8, 58], adolescence is a crucial period with lifelong effects for health and habits. One suggested explanation is that adolescents are more present-oriented than adults; they overemphasise the ‘costs’ of health-related decisions and discount the value of future benefits [22] and, therefore, can be less likely to engage in health-related behaviours [33, 57]. The use of an engaging intervention using behavioural incentives could help initiate physical activity motivation in more present-orientated individuals by offsetting the immediate ‘costs’ [56].
Gamification is an emerging area in physical activity research that incorporates the use of relevant game design elements in non-gaming contexts [13] which can add fun and enjoyment to physical activity interventions. Gamification theory suggests that it should be possible to turn a routine non-game activity such as travel to school into an engaging and fun game [12]. Although some argue that gamification is just a fad [30, 62], the recent success of Pokémon GO illustrates the potential of gamified interventions for encouraging physical activity [37] and provides insights into how to engage and initiate the most inactive people in physical activity in the short term [63]. Additionally, the recent feasibility testing of gamified interventions using school-based walking competitions to increase active travel in children and adolescents shows promise [7, 23].
Key gamification strategies include using extrinsic (e.g. incentives) and intrinsic (e.g. perceived enjoyment, increasing skills) motivators, the use of challenges and competitions and fostering social connectivity [50]. There is emerging evidence that incentives, which are provided contingent on effort towards the behaviour or successful performance of the target behaviour [38], can be successfully incorporated into physical activity interventions targeting adolescents [10]. Competitions and challenges have shown some success in smoking cessation interventions in adolescents [26] but there is currently limited research investigating the effects of competition on physical activity behaviour change [10]. In addition, friendship networks and the use of peer influencers are associated with physical activity behaviour in adolescents [35, 36, 51, 53] and may influence physical activity behaviour within interventions [24].
Gamification interventions have rarely been grounded in well-established theoretical frameworks [28, 30]. Nonetheless, research has suggested a link between self-determination theory and gamification concepts, as exemplified by the use of extrinsic and intrinsic motivators, competition and challenges and social interaction [47, 52]. Furthermore, the fact that games can make interventions more enjoyable aligns with self-determination theory which postulates that enjoyment is a key aspect of intrinsic motivation [13]. This is reinforced by Best et al. [1] who used survey data to investigate correlates of daily physical activity behaviour in children and adolescents and found fun and enjoyment to be predictors of physical activity.
Although schools appear to be a suitable location in which to deliver physical activity interventions [3, 14, 25], there is a need for more high-quality studies, with process evaluation to understand whether the intervention itself is ineffective or how contextual factors might influence this [31, 39].
This study investigated the feasibility of implementing and evaluating a school-based gamified pedometer competition designed to promote physical activity among 12–14-year-olds, known as ‘The StepSmart Challenge’ (trial number: NCT02455986), which integrates core gamification strategies with self-determination theory. A previous publication details the participants’ experiences of The StepSmart Challenge, in particular the competition formats and use of incentives [9] which appeared to encourage most participants. Participants wore Fitbit Zip pedometers, which appeared to be important for self-directed goal setting, monitoring and immediate feedback.
The specific aims of the feasibility study were to
- 1.
Test recruitment strategies for schools and adolescents;
- 2.
Determine retention rates for schools and adolescents;
- 3.
Assess the appropriateness of proposed outcome measures based on completion rates, missing data and proportion of valid data provided; and
- 4.
Explore the intervention’s acceptability and possible refinements to improve its design.
Methods
Study design
The present study was a two-arm parallel feasibility cluster randomised controlled trial comparing ‘The StepSmart Challenge’ and a no-intervention control arm. Five post-primary schools from Belfast, Northern Ireland were recruited. Randomisation took place at the school level, with three schools randomised to the intervention and two schools to the control. The intervention took place from April 2015 to September 2015. Ethical approval was granted by the School of Medicine, Dentistry and Biomedical Science Research Ethics Committee (Queen’s University, Belfast) (Ref: 15.09).
Recruitment of schools
Schools
The sample consisted of post-primary schools in Belfast. For pragmatic reasons, we choose to select our sample from a list of schools which had previously participated in research projects with QUB and were therefore familiar with the time and processes involved. We sent letters of invitation to participate in the trial to a purposive sample of 14 of these schools and made follow-up phone calls to the school principal to explain the purpose of the study. We aimed to invite a mix of schools from affluent and deprived areas (using free school meal eligibility as a proxy measure), and of single-sex and co-educational schools (using public information [15]). Only the first five schools to accept the invitation were recruited due to the scope of the study and the resources available. A stratified randomisation process (stratified by socio-economic status, and whether schools were single-sex or co-educational) was undertaken by an independent statistician to assign schools to the intervention or control group using software available at http://www.randomization.com. As the randomisation was undertaken to assess the feasibility of the randomisation process, all school characteristics were included despite the small number of participating schools. Randomisation resulted in three schools allocated to the intervention group, and two schools to the control group.
Participants
Schools were asked to identify ear 9 classes (12–14-year-olds) to participate, aiming to recruit up to 50 adolescents within each school. No formal criteria were applied to class selection; however, we asked teaching staff to recruit classes that were representative of the wider school population in relation to academic ability, gender (if relevant) and perceived physical activity behaviour. We believe the class teachers were well placed to have knowledge regarding perceived physical activity levels, based on, for example, whether adolescents were involved in sports teams or not. Input from teaching staff was important as they were best placed to assess any potential conflicts that may have impacted upon the team component of The StepSmart Challenge.
Following class selection, the research team organised an information session in each school to provide teachers and the selected classes with more details about the study and an opportunity to ask questions. Information sheets, consent forms and parental/guardian opt-out consent forms were provided to adolescents to read and take home to parents/guardians, to allow them time to assimilate the information and make an informed decision. If adolescents wished to take part, they were asked to provide written consent. Adolescents were excluded from the study if (a) their parents informed the school that the adolescent had been advised by their general practitioner not to undertake moderate physical activity, (b) they were not in Year 9, and (c) they had not provided assent or if their parents had completed the parental opt-out written consent form.
Intervention
The StepSmart Challenge used gamification strategies, combined with the core tenets of self-determination theory, to encourage and support physical activity behaviour change by moving participants along the motivation continuum (from more external forms of motivation, e.g. external regulation) towards intrinsic motivation (e.g. identified regulation) [46], as shown in the intervention logic model (Fig. 1). Researchers visited each intervention school at baseline to collect outcome measures. It was during this time that researchers reiterated (provided initially during the information session) the specific details about what the intervention involved, e.g. explanations were provided about the competition elements, the material and social incentives and The StepSmart Challenge website.
The StepSmart Challenge logic model
The StepSmart Challenge consisted of two distinct phases (Table 1 shows key intervention components and potential mechanisms). In summary, phase 1 (8 weeks) comprised of competitions on three levels: inter-school, between the three intervention schools; within-school, team-based; and within-school, individual. This phase used a range of material and social incentives to promote physical activity. For the inter-school competition, Fitbit Zip data collected from the three intervention schools was collated to produce an aggregate score for each school. Teachers informed participants on the progress of their school on a weekly basis. This information was also available to participants via The StepSmart Challenge website. At the end of phase 1, the intervention school with the highest number of aggregate steps was awarded a £1000 prize. The within-school team-based competition ran alongside the inter-school competition and involved approximately 10 teams within each school (four to five adolescents within each team). The selection of teams took current physical activity levels and friendship networks into account (obtained from baseline outcome assessments), to ensure that each team included participants with a range of physical activity levels and at least one friend. The aggregate step count of each team was updated weekly on The StepSmart Challenge website leader board. The team with the highest number of aggregate steps within each school at the end of phase 1 were the winners. The team competition was comprised of social incentives such as the publication of results on The StepSmart Challenge website and a trophy which was awarded to the leading team in each school at the end of the competition. The within-school individual competition ran alongside the inter-school, and within-school team-based competitions. Each week, participants within each school competed to be the ‘walker of the week’ (the participant that had accumulated the most steps in the week) or the ‘most improved’ participant (the participant that had increased their step count the most from the previous week). The two weekly winners in each school would receive material incentives such as selfie sticks and vouchers (approximate value of £10) and a social incentive (a certificate of achievement).
Phase 2 (14 weeks) began immediately after phase 1 ended and consisted of a within-school individual pedometer competition. Participants were encouraged to complete weekly challenges to increase their steps via The StepSmart Challenge website. Other missions encouraged participants to go walking with friends and family. This encouraged pro-social behaviour among participants in relation to physical activity outside of a school and the team-based competition format. Phase 2 represented a tapered withdrawal from the extrinsically motivated behaviour change techniques towards more intrinsically motivated behaviours. Instead of weekly prizes, the three highest performing participants in each school were each presented with a trophy and a ‘goody bag’ (approximate value of £30, consisting of an assortment of material incentives used in phase 1). Other incentives were more abstract and took the form of ‘virtual badges’ to represent their achievements; this could be viewed on a participant’s personal profile on The StepSmart Challenge website. Before the start of phase 2, participants were invited to join a closed Facebook group. This provided participants with a convenient way to contact research staff an opportunity to share their progress and a platform for research staff to suggest different types of physical activity and provide motivational messages.
Control
Control participants did not receive any form of intervention. The participants were not provided with Fitbit Zip pedometers, and they did not take part in the competitions and did not receive material or social incentives during the intervention period. Control participants were asked to complete the same outcome assessments as the intervention group at each time point. Control group schools were each given £400 to cover the cost of staff time associated with participation in the study.
Outcome measures
Recruitment and retention
The numbers of schools and adolescents who were invited to participate and consented were recorded at T0 (baseline). The numbers of schools and participants who withdrew, were lost to follow up and retained were recorded post-intervention, at 22 weeks (T1) and T2 (52 weeks).
Proposed outcome measures
Minutes of daily moderate-to-vigorous physical activity (MVPA) were measured using validated ActiGraph GT3X/GT3X+ accelerometers (ActiGraph Inc., USA). Accelerometers were provided to participants at T0, T1 and T2 to wear for 7 consecutive days and to only remove it when bathing, swimming or sleeping. Activity counts using the accelerometers were recorded in 1 s epochs. In order to obtain total minutes of MVPA per day, the data were reintegrated in 60 s epochs before Evenson cut off points were applied to the data [16]. Non-wear time was defined as a run of zero counts lasting more than 60 min [5]. Valid data were defined as (a) a minimum of 8 h/day wear-time and (b) for at least 3 days [2, 27]. At each time point, participants at each school completed paper-based questionnaires in their respective classrooms. The questionnaires included the Warwick-Edinburgh Mental Wellbeing Scale (WEMWBS) [59], perceived social support for physical activity [49], social networks [19] and a future orientation scale to measure time preferences [42]. Class teachers completed the Strength and Difficulties Questionnaire (SDQ) at their desk for each participant in their classroom, while participants were completing the paper-based questionnaires that they were provided. The SDQ is used to assess emotional and behavioural problems and pro-social behaviour [18].
Outcome measures were administered by members of the research team (RC, PB, RON, MT and RH) during agreed scheduled classes on the school premises. Teachers completed a Strength and Difficulties Questionnaire for each participating pupil in their class while the pupils were completing their questionnaires. To explore the acceptability of the intervention and study design, focus groups were conducted at all the above time points and at the end of phase 1(8 weeks post-baseline) (Table 2).
Intervention acceptability
Repeated semi-structured focus groups were conducted with a subsample of adolescent participants in each school. The same participants were invited at each focus group. Participants were recruited using purposive sampling in consultation with teaching staff. Teachers identified potential participants with a range of physical activity levels (low to high) as well as mixed educational ability. Three focus groups were conducted in each intervention school (at T0, T1 and T2), and two focus groups were conducted in each control school (at T0 and T2). Participants (n = 33) were recruited using purposive sampling in consultation with teaching staff. Teachers identified potential participants with a range of physical activity levels (low to high) as well as mixed educational ability. The same participants were invited at each focus group; however, the number of participants varied due to school absences (mean of 6 participants; range 2–7 participants). No participants refused to take part or dropped out of the focus group discussions. Focus groups were conducted by PB, RC and RO’N. RC was present at all focus groups, and either PB or RO’N supported RC by taking field notes at each session. The focus groups lasted on average 33 min (range 21–41 min) and were audio-recorded and transcribed verbatim. The topic guide was refined iteratively following interim analysis at each data collection point. Additional file 1 details the topic guide for the focus groups.
At T2, a focus group was also conducted with three teachers from intervention schools. This focus group was audio-recorded and transcribed verbatim.
Analyses
Proportions were used to describe the recruitment rates (for schools and participants) and the retention rates at T1 and T2. Descriptive analyses were performed using the Statistical Package for Social Sciences (SPSS) version 22.0 (SPSS Inc., Chicago, USA). Due to the non-normal distribution of the accelerometer data, median and interquartile ranges (IQR) were calculated for these outcomes. Accelerometer data were processed using ActiLife version 6.13.1 (ActiGraph Inc., USA). Imputation analysis using last observation carried forward (LOCF) was conducted to treat missing data [21] for the accelerometer data. Outcome data from WEMWBS and SDQ were normally distributed and were therefore presented as mean and standard deviation (SD). All other outcomes were non-normally distributed and presented as median and IQR. Exploratory analysis was conducted on the association between friendship within teams and physical activity, using R version 3.3.2. Accelerometer data were processed using the ActiGraph software package version 1.0.1 [11]. Feasibility studies are not designed to investigate the effectiveness of interventions [29]. Thus, no significance testing was conducted.
Intervention acceptability
All focus group transcripts were imported into NVivo (Version 10, QSR, Southport, UK) to manage and support analysis using the thematic analysis framework [4]. Initially, researchers (RC and PB) familiarised themselves with the data. RC and PB developed a sample coding frame independently and this was refined iteratively with subsequent discussions. Anonymised illustrative quotes supporting emerging themes were highlighted and agreed by researchers.
Results
Aims 1 and 2: to test the feasibility of recruiting and retaining schools and adolescents in The StepSmart Challenge
Fourteen schools were approached to participate in the study (see Fig. 2). Schools were given 1 week to respond before a follow-up phone call was made by a member of the research team. In total, 11/14 schools responded: 8 were interested in participating and we recruited the first 5 of these respondents. Three other respondents declined to take part for the following reasons: (1) already committed to other research projects, (2) staff pressures and (3) timetabling issues. Baseline characteristics of participating schools are shown in Table 3. Most participating schools were single-sex schools. Three schools had high levels of free school meal eligibility (> 37.5%). Of the 236 students who were invited to participate, 224 (94.9%) provided written consent.
CONSORT participant flow diagram
Aim 3: to assess feasibility of using the proposed outcome measures
At T0, 214/224 (95.5%) participants returned accelerometers, of which 190/224 (84.8%) of participants returned valid data for minutes/day of MVPA (Additional file 2 shows data by school). At T2, 198/214 (92.5%) participants returned accelerometers; 123/214 (57.4%) returned valid data for analysis. Overall, almost half, 21/44 (47%), of the unreturned devices were attributed to school A. School A was assigned to the control group and was based in an area of high disadvantage. Table 4 shows the completion rates for all proposed outcomes. The completion of WEMWBS ranged from 213/224 (95.0%) at T0 to 195/224 (87.0%) at T2. Response rates for SDQs from teachers were low (65%) during T0 due to staff absence within one school.
Table 4 shows the potential for change using the proposed outcomes (for the social network analysis, see Additional file 2). Daily minutes of MVPA (our proposed primary outcome) for the intervention group remained unchanged from baseline at T1 and T2. In the control group, there was a slight increase from baseline in MVPA at T1 (47.4 min/day; IQR 32.7 to 65.1), which decreased closer to baseline levels at T2 (37.2 min/day; IQR 26.5 to 53.1). The data from all other outcomes remained relatively stable at each point.
At each time point, between two and six researchers facilitated data collection in each school depending on staff availability, with PB, RC or R’ON present on every occasion to lead the collection process. Data collection in each school would occur at a prearranged time and day with the majority of participant questionnaire data collected at this time. On occasion, it would be necessary to return to schools to collect questionnaire data for participants who were absent during the data collection session. During the data collection sessions, teachers were provided with the SDQ’s to complete. However, it was not always possible for teachers to complete these during the time researchers were present in the school. In such cases, a researcher would return to the school to collect the SDQ’s a short time after the data collection visit. At each data collection period, researchers were often required to visit each school multiple times to collect accelerometers due to participant absences, participants forgetting to bring them into school or having misplaced the accelerometers. At each time point, accelerometer data was downloaded and processed by one researcher. Accelerometer data was downloaded and processed at each time point in batches (by school), and it would take approximately an half a day to complete the process for each school. At each time point, two researchers were involved in pedometer data collection and analysis.
Aim 4: to explore intervention acceptability and identify any refinements that could be made to The StepSmart Challenge
Our focus group findings are reported under three main themes: participant acceptability of the intervention, teachers’ perception of relevance of intervention and key implementation findings in The StepSmart Challenge.
Participant acceptability of key intervention components
Generally, participants spoke positively regarding taking part in The StepSmart Challenge. In particular, the competition format and incentives on the offer appeared to encourage participation, ‘Every week cos you know it’s like running out of time for like the prizes, [and I] just really want to get one’ (school C, male, T1). However, for some, the competitive nature of the intervention appeared to be viewed as ‘off putting’ as one participant noted, ‘It’s just sort of cause you knew you probably were not going to win so you are just like there’s really no point in wearing [the FitBit Zip pedometer]’ (school E, female, T2). This was despite the presence of a weekly prize for the ‘most improved’ participant.
Team-based competition appeared to be an acceptable approach to encouraging physical activity among participants with qualitative data suggesting a significant role played by peer networks, both in terms of pro-social behaviour ‘when you have your friend with you…you’d be more encouraged to do more walking’ (female, school D) and goal setting ‘you’re just trying to beat your friends’ (male, school C, T1). However, team-based competition was not without its caveats. While some participants highlighted its benefits, ‘if they [team mates] want to go for a run you will want to go for a run with them’ (school C, male, T0), there were some issues in relation to the compositions of teams. Girls, in particular, showed a preference for team(s) based on current friendship networks rather than on a mix of ability in relation to PA; ‘It would have been easier if we were with our friends’ (school D, female, T1) and if ‘you don’t like people in your team you’re just going to be like…[I’m] not even going to talk to you’ (school E, female, T2).
Participants’ comments indicated that they did not use The StepSmart Challenge website regularly and many preferred using the Fitbit mobile application or the display on the Fitbit Zip to track scores; ‘I just didn’t think there was any point cause like you could see it on the pedometer’ (school D, female, T2) and ‘I think loads of people used the app [Fitbit] much more. Some people probably didn’t even go onto the website’ (school D, female, T2). Pupils appeared to engage less with the workbook, preferring to use the Fitbit application instead.
Teachers’ perceptions of relevance of intervention
The gender component of the competition was reflected upon within teacher interviews; ‘Boys probably wanted it more for the competition element…their friendship groups at our place [school] are pretty much made up with who they play sport with. Sport’s a massive social thing in our place [school] as well. So, they want to beat their mate, not be in a group with them’ (school C, teacher 1). While teachers representing the girls’ schools stated that they were grateful to be involved in this type of study, they acknowledged the number of girls who regularly engage in sport was relatively minor: ‘What we were finding at our sports days was the usual girls were winning everything’ (school D, teacher 1).
Teachers suggested that the incentives were important to encourage engagement but felt that the value of prizes could be reduced in favour of being able to offer them more often; ‘Scaling down maybe the prizes to make more prizes but at a lesser value… this is not to be nasty to children, but they’ll be impressed by nearly anything.’ (school C, teacher 1). Moreover, providing incentives for reaching a certain level was also suggested, ‘[If] they have reached that level…then you’re rewarding more children than just the one, [they] deserve a reward’ (school C, teacher 2). Teachers suggested that while the workbook was useful, it felt too much like homework to pupils, ‘I think they were easy enough to use …[but] they see that as work; they don’t see that as that’s just a sheet or a book, no, it’s work’ (school C, teacher 1).
The StepSmart Challenge also appeared to go beyond physical health and physical activity and was thought of more as a ‘wellbeing’ or ‘social’ intervention by teachers. As one teacher noted, ‘Some of it could be maths, art or whatever, but it’s that sort of feeling of group togetherness…whether it’s well-being mentally or well-being physically, [can have] an impact on them’ (school C, teacher 1). This view was supported within another school: ‘I think yours [StepSmart] has provided a starting point for us…that we can take it forward and look at the whole physical and mental health of pupils’ (school E, teacher 2).
Future implementation
Several participants suggested that wrist-worn devices for monitoring physical activity could reduce loss and increase wear time; ‘I think…you can get those [pedometers] in your wrists but they are more expensive and maybe a lot better like but for people our age… it’s like a lot like getting changed after the shower etc. so we always forgot to like put it on.’ (school C, male, T2). This preference for wrist-worn devices may also extend to the wearing of accelerometers for measuring physical activity; ‘Something else maybe that you can just put on your wrist might be a little bit easier’ (school D, female, T1) and ‘It’s the fact that you could see it like with a crop top [when] you’re walking’ (school E, female, T2).
Further, it was suggested that The StepSmart Challenge may be expanded to other subjects out with Physical Education (P.E.), ‘It worked very well in the P.E. department, but I can see how it can lend itself to other departments in relation to whether it’s the maths department, the science department, which would be good’ (school E, teacher 1).
Regarding implementation, it was noted that parental opt-out consent was a particularly valuable and welcomed approach, ‘Opt out I find, when you’re dealing with children and parents, is always better’ (school A, teacher 2) and ‘It’s [parental opt-out] easier because they don’t have to sign anything’ (school B, teacher 1). Teachers felt this significantly reduced their administration burden and the task of ‘chasing up’ outstanding parental consent forms.
Discussion
Our findings suggest that The StepSmart Challenge, a gamified physical activity intervention, is acceptable to adolescents aged 12–14 years. Recruitment and retention rates of schools and participants indicate that it is feasible to scale up the intervention for an effectiveness trial. In general, the questionnaires were well understood and completed at each time point and were deemed appropriate for use in a future study. However, The StepSmart Challenge would benefit from the refinement of the website used and participant workbooks, and there is a need to explore how to maximise the return of valid accelerometer data from participants, as well as questionnaire data from teachers.
Participant recruitment and retention was high in both the intervention and control groups. A contributing factor to participant recruitment was the use of parental opt-out consent. Tigges [61] noted an increase of approximately one third when choosing passive (opt-out) as opposed to active (opt-in) parental consent. Extensive discussions took place with the schools regarding the process of parental opt-out consent, but we recognise that this may depend on the nature of the intervention. It has also been suggested that passive consent is more inclusive of those less engaged within the school system or those from ethnic minority backgrounds [61]. A limitation of opt-out consent was not having the contact details of parents or participants in order to send reminders or prompt wearing of accelerometers. This disadvantage in using opt-out consent has also been shown in previous research by [8].
Approaches to improve the return of accelerometer data require further consideration before scaling up for a full trial. Difficulties were encountered within one of the control boys schools which accounted for 11/35 (31.4%) of accelerometers not returned and of those who returned only 9/24 (37.5%) provided valid data. A range of additional efforts was made to try to improve retention rates and the return of devices, such as additional visits to the schools by the research team, letters sent to parents from the school principal and offering vouchers for the return of devices. Participants in the control schools did not receive any intervention nor were they on a waiting list to receive the intervention. Therefore, participants may not have felt particularly incentivised to complete the outcome measures. Future research could explore the use of wrist-worn accelerometers or increasing the value of vouchers provided on return of accelerometers. Many post-primary schools have adopted a text messaging service to relay information to parents. Utilising this system to deliver prompts could be one way to improve participant wear time and the return of accelerometers but would inevitably impose further burden on the schools.
Research by Hunter et al. [23] suggests that competition may extrinsically motivate and encourage physical activity behaviour among school children. The findings from our qualitative data reported in a previous publication [9] highlighted that participants felt competition could provide a sense of enjoyment, feelings of competence and wellbeing which is consistent with the self-determination theory. Building on this, teacher focus groups proposed the benefit of changing the incentive structure in the competition which would allow more participants to be rewarded. This positive feedback might increase engagement in participants and encourage long-term physical activity behaviour change. Implementing The StepSmart Challenge as part of a health promotion programme embedded in the school curriculum could be a method to add the physical activity education and knowledge acquisition elements of The StepSmart Challenge without increasing the burden on teachers [41]. This holistic approach to The StepSmart Challenge was supported by teachers who felt that a lifelong learning approach to The StepSmart Challenge would be needed and to get the buy-in from senior staff in school [43].
A novel aspect of this school-based study was the purposeful effort to continue the study across the summer months. This was made possible by The StepSmart Challenge website and Fitbit application, through which participants could track and monitor their progress, as well as complete challenges and receive virtual reward badges (phase 2). Continuation over the summer holidays was viewed as important to try and maintain healthy physical activity habits outside of the school context. The accessibility of the application (via mobile phones) appeared to be preferable to using the study website and qualitative data suggested that most participants who were actively engaged in the study uploaded pedometer data via the Fitbit application.
Conclusions
As young people’s lives become more intertwined with technology, the use of innovative gamified interventions could be one approach to engage and motivate behavioural change in this population. Results from this feasibility study have provided support for the acceptability of an intervention that incorporates such approaches. The study also demonstrated the suitability of the proposed school and participant recruitment methods and using parental opt-out procedures. Further thought must be given to how we boost accelerometer retention in future studies and how the intervention can be embedded within the school curriculum. Incorporating process evaluations and qualitative research in future research would add further depth to our understanding of outcome evaluations and provide insight into the intervention’s external validity which is necessary before decisions are made to scale up public health interventions.
Availability of data and materials
The datasets generated and/or analysed during the current study are not publicly available due to the requirement from the ethics review committee but are available from the corresponding author on reasonable request.
Abbreviations
- BCTs:
-
Behaviour change techniques
- CPM:
-
Counts per minute
- IQR:
-
Interquartile range
- LOCF:
-
Last observation carried forward
- MVPA:
-
Moderate to vigorous physical activity
- NICE:
-
National Institute for Health and Care Excellence
- PE:
-
Physical Education
- SD:
-
Standard deviation
- SDQ:
-
Strength and Difficulties Questionnaire
- SDT:
-
Self-determination theory
- SPSS:
-
Statistical Package for Social Sciences
- T0:
-
Baseline
- T1:
-
End of phase 2 (22 weeks post-baseline)
- T2:
-
Follow up (52 weeks post-baseline)
- WEMWBS:
-
Warwick-Edinburgh Mental Wellbeing Scale
References
- 1.
Best P, Tully MA, Corepal R, Kee F, Hunter RF. Time to ‘re-think’ physical activity promotion for young people? Results from a repeated cross-sectional study. BMC Public Health. 2017;17:208.
- 2.
Bingham DD, Costa S, Clemes SA, Routen AC, Moore HJ, Barber SE. Accelerometer data requirements for reliable estimation of habitual physical activity and sedentary time of children during the early years - a worked example following a stepped approach. J Sports Sci. 2016;34:2005–10.
- 3.
Borde R, Smith JJ, Sutherland R, Nathan N, Lubans DR. Methodological considerations and impact of school-based interventions on objectively measured physical activity in adolescents: a systematic review and meta-analysis. Obes Rev. 2017;18:476–90.
- 4.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.
- 5.
Cain K, Geremia C. Accelerometer data collection and scoring manual for adult & senior studies. San Deiago: San Diego Stae University; 2012.
- 6.
Casey MM, Eime RM, Payne WR, Harvey JT. Using a socioecological approach to examine participation in sport and physical activity among rural adolescent girls. Qual Health Res. 2009;19:881–93.
- 7.
Coombes E, Jones A. Gamification of active travel to school: a pilot evaluation of the beat the street physical activity intervention. Health Place. 2016;39:62–9.
- 8.
Corder K, Brown HE, Schiff A, van Sluijs EM. Feasibility study and pilot cluster-randomised controlled trial of the GoActive intervention aiming to promote physical activity among adolescents: outcomes and lessons learnt. BMJ Open. 2016;6:e012335.
- 9.
Corepal R, Best P, O'Neill R, Tully MA, Edwards M, Jago R, Miller SJ, Kee F, Hunter RF. Exploring the use of a gamified intervention for encouraging physical activity in adolescents: a qualitative longitudinal study in Northern Ireland. BMJ Open. 2018a;8:e019663.
- 10.
Corepal R, Tully MA, Kee F, Miller SJ, Hunter RF. Behavioural incentive interventions for health behaviour change in young people (5-18years old): a systematic review and meta-analysis. Prev Med. 2018b;110:55–66.
- 11.
Csardi G, Nepusz T. The igraph software package for complex network research. InterJ Complex Syst. 2006;1695(5):1–9.
- 12.
Cugelman B. Gamification: what it is and why it matters to digital health behavior change developers. JMIR Serious Games. 2013;1:e3.
- 13.
Deterding S, Dixon D, Khaled R, Nacke L. From game design elements to gamefulness: defining gamification. In: Proceedings of the 15th international academic MindTrek conference: envisioning future media environments: ACM; 2011. p. 9–15.
- 14.
Dobbins M, Husson H, DeCorby K, LaRocca RL. School-based physical activity programs for promoting physical activity and fitness in children and adolescents aged 6 to 18. Cochrane Database Syst Rev. 2013:CD007651.
- 15.
DoE. School enrolments - school level data: Department of Education; 2015.
- 16.
Evenson KR, Catellier DJ, Gill K, Ondrak KS, McMurray RG. Calibration of two objective measures of physical activity for children. J Sports Sci. 2008;26:1557–65.
- 17.
Fitzgerald A, Fitzgerald N, Aherne C. Do peers matter? A review of peer and/or friends' influence on physical activity among American adolescents. J Adolesc. 2012;35:941–58.
- 18.
Goodman R. The Strengths and Difficulties Questionnaire: a research note. J Child Psychol Psychiatry. 1997;38:581–6.
- 19.
Hanneman RA, Riddle M. Introduction to social network methods. Riverside: University of California, Riverside; 2005. (published in digital form at http://faculty.ucr.edu/~hanneman/)
- 20.
Harrington DM, Murphy M, Carlin A, Coppinger T, Donnelly A, Dowd KP, Keating T, Murphy N, Murtagh E, et al. Results from Ireland north and South’s 2016 report card on physical activity for children and youth. J Phys Act Health. 2016;13:S183–S88.
- 21.
He J, McClish D. The application of last observation carried forward in the persistent binary case. Austin Biom Biostat. 2015;2:1018.
- 22.
Humphreys BR, Ruseski JE, Zhou L. Physical activity, present bias, and habit formation: theory and evidence from longitudinal data. Working Paper No. 2015-06; 2015.
- 23.
Hunter RF, de Silva D, Reynolds V, Bird W, Fox KR. International inter-school competition to encourage children to walk to school: a mixed methods feasibility study. BMC Res Notes. 2015a;8:19.
- 24.
Hunter RF, McAneney H, Davis M, Tully MA, Valente TW, Kee F. “Hidden” social networks in behavior change interventions. Am J Public Health. 2015b;105:513–6.
- 25.
Hynynen ST, van Stralen MM, Sniehotta FF, Araujo-Soares V, Hardeman W, Chinapaw MJ, Vasankari T, Hankonen N. A systematic review of school-based interventions targeting physical activity and sedentary behaviour among older adolescents. Int Rev Sport Exerc Psychol. 2016;9:22–44.
- 26.
Isensee B, Hanewinkel R. Meta-analysis on the effects of the smoke-free class competition on smoking prevention in adolescents. Eur Addict Res. 2012;18:110–5.
- 27.
Jago R, Edwards MJ, Sebire SJ, Tomkinson K, Bird EL, Banfield K, May T, Kesten JM, Cooper AR, et al. Effect and cost of an after-school dance programme on the physical activity of 11-12 year old girls: the Bristol Girls Dance Project, a school-based cluster randomised controlled trial. Int J Behav Nutr Phys Act. 2015;12:128.
- 28.
Johnson D, Deterding S, Kuhn K-A, Staneva A, Stoyanov S, Hides L. Gamification for health and wellbeing: a systematic review of the literature. Internet Interv. 2016;6:89–106.
- 29.
Lancaster GA. Pilot and feasibility studies come of age! Pilot Feasibility Stud. 2015;1:1.
- 30.
Lister C, West JH, Cannon B, Sax T, Brodegard D. Just a fad? Gamification in health and fitness apps. JMIR Serious Games. 2014;2:e9.
- 31.
Love R, Adams J, van Sluijs EMF. Are school-based physical activity interventions effective and equitable? A meta-analysis of cluster randomized controlled trials with accelerometer-assessed activity. Obes Rev. 2019;20:859–70.
- 32.
Lubans DR, Plotnikoff RC, Miller A, Scott JJ, Thompson D, Tudor-Locke C. Using pedometers for measuring and increasing physical activity in children and adolescents. Am J Lifestyle Med. 2014;9:418–27.
- 33.
Lührmann, M., Serra-Garcia, M., Winter, J., 2013. Measuring teenagers’ time preferences using convex time budgets. CESifo Area Conference on Behavioral Economics.
- 34.
Luoto J, Carman KG. Behavioral economics guidelines with applications for health interventions: Inter-American Development Bank; 2014.
- 35.
Macdonald-Wallis K, Jago R, Sterne JA. Social network analysis of childhood and youth physical activity: a systematic review. Am J Prev Med. 2012;43:636–42.
- 36.
Maturo CC, Cunningham SA. Influence of friends on children's physical activity: a review. Am J Public Health. 2013;103:e23–38.
- 37.
McCartney M. Game on for Pokemon Go. BMJ. 2016;354:i4306.
- 38.
Michie S, Richardson M, Johnston M, Abraham C, Francis J, Hardeman W, Eccles MP, Cane J, Wood CE. The behavior change technique taxonomy (v1) of 93 hierarchically clustered techniques: building an international consensus for the reporting of behavior change interventions. Ann Behav Med. 2013;46:81–95.
- 39.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O'Cathain A, Tinati T, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2015;350:h1258.
- 40.
Ommundsen Y, Page A, Ku PW, Cooper AR. Cross-cultural, age and gender validation of a computerised questionnaire measuring personal, social and environmental associations with children's physical activity: the European Youth Heart Study. Int J Behav Nutr Phys Act. 2008;5:29.
- 41.
Pearson M, Chilton R, Wyatt K, Abraham C, Ford T, Woods HB, Anderson R. Implementing health promotion programmes in schools: a realist systematic review of research and experience in the United Kingdom. Implement Sci. 2015;10:149.
- 42.
Peretti-Watel P, L'Haridon O, Seror V. Time preferences, socioeconomic status and smokers' behaviour, attitudes and risk awareness. Eur J Pub Health. 2013;23:783–8.
- 43.
Perry CL, Sellers DE, Johnson C, Pedersen S, Bachman KJ, Parcel GS, Stone EJ, Luepker RV, Wu M, et al. The Child and Adolescent Trial for Cardiovascular Health (CATCH): intervention, implementation, and feasibility for elementary schools in the United States. Health Educ Behav. 1997;24:716–35.
- 44.
Roberto CA, Kawachi I. Behavioral economics and public health. New York: Oxford University Press; 2015.
- 45.
Routen AC, Upton D, Edwards MG, Peters DM. The effect of pedometer step goal, feedback and self-monitoring interventions on accelerometer-measured physical activity in children. Grad J Sport Exerc Phys Educ Res. 2014;2:37–53.
- 46.
Ryan RM, Deci EL. Self-determination theory: basic psychological needs in motivation, development, and wellness. New York: Guilford Publications; 2017.
- 47.
Ryan RM, Rigby CS, Przybylski A. The motivational pull of video games: a self-determination theory approach. Motiv Emot. 2006;30:344–60.
- 48.
Sallis JF, Bull F, Guthold R, Heath GW, Inoue S, Kelly P, Oyeyemi AL, Perez LG, Richards J, et al. Progress in physical activity over the Olympic quadrennium. Lancet. 2016;388:1325–36.
- 49.
Sallis JF, Prochaska JJ, Taylor WC, Hill JO, Geraci JC. Correlates of physical activity in a national sample of girls and boys in grades 4 through 12. Health Psychol. 1999;18:410–5.
- 50.
Sardi L, Idri A, Fernandez-Aleman JL. A systematic review of gamification in e-health. J Biomed Inform. 2017;71:31–48.
- 51.
Sawka KJ, McCormack GR, Nettel-Aguirre A, Swanson K. Associations between aspects of friendship networks and dietary behavior in youth: findings from a systematized review. Eat Behav. 2015;18:7–15.
- 52.
Seaborn K, Fels DI. Gamification in theory and action: a survey. Int J Hum Comput Stud. 2015;74:14–31.
- 53.
Sebire SJ, Jago R, Banfield K, Edwards MJ, Campbell R, Kipping R, Blair PS, Kadir B, Garfield K, et al. Results of a feasibility cluster randomised controlled trial of a peer-led school-based intervention to increase the physical activity of adolescent girls (PLAN-A). Int J Behav Nutr Phys Act. 2018;15:50.
- 54.
Skinner BF. Science and human behavior. New York: Simon and Schuster; 1953.
- 55.
Stewart-Brown S, Janmohamed K. Warwick-Edinburgh mental well-being scale. In: User guide. Version 1; 2008.
- 56.
Strohacker K, Galarraga O, Williams DM. The impact of incentives on exercise behavior: a systematic review of randomized controlled trials. Ann Behav Med. 2014;48:92–9.
- 57.
Sutter M, Kocher MG, Glätzle-Rützler D, Trautmann ST. Impatience and uncertainty: experimental decisions predict adolescents’ field behavior. Am Econ Rev. 2013;103:510–31.
- 58.
Telama R, Yang X, Leskinen E, Kankaanpaa A, Hirvensalo M, Tammelin T, Viikari JS, Raitakari OT. Tracking of physical activity from early childhood through youth into adulthood. Med Sci Sports Exerc. 2014;46:955–62.
- 59.
Tennant R, Hiller L, Fishwick R, Platt S, Joseph S, Weich S, Parkinson J, Secker J, Stewart-Brown S. The Warwick-Edinburgh Mental Well-being Scale (WEMWBS): development and UK validation. Health Qual Life Outcomes. 2007;5:63.
- 60.
Thorgeirsson T, Kawachi I. Behavioral economics: merging psychology and economics for lifestyle interventions. Am J Prev Med. 2013;44:185–9.
- 61.
Tigges BB. Parental consent and adolescent risk behavior research. J Nurs Scholarsh. 2003;35:283–9.
- 62.
Wise J. Pokémon Go's health benefits seem short lived. BMJ. 2016;355:i6684.
- 63.
Wong FY. Erratum to: influence of Pokemon Go on physical activity levels of university players: a cross-sectional study. Int J Health Geogr. 2017;16:17.
- 64.
Zimmerman FJ. Using behavioral economics to promote physical activity. Prev Med. 2009;49:289–91.
Acknowledgements
The authors wish to thank the pupils and teachers who were involved in the development of this intervention and those who participated in the study. The authors wish to acknowledge funding from a HSC R&D (NI) Enabling Research Award.
Funding
The authors received funding from a HSC R&D (NI) Enabling Research Award. RC was supported by a PhD studentship from the Department for the Economy, Northern Ireland. RFH is supported by a NIHR Career Development Fellowship and acknowledges funding support from the HSC Research and Development Division. The work was undertaken under the auspices of the UKCRC Centre of Excellence for Public Health Research, Northern Ireland, which is funded by the British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the National Institute for Health Research and the Wellcome Trust. None of the funding bodies had a role in the design of the study and the collection, analysis and interpretation of data and in writing the manuscript.
This work was additionally supported by the Medical Research Council (Unit Programme number MC_UU_12015/7) and the Centre for Diet and Activity Research (CEDAR), a UKCRC Public Health Research Centre of Excellence. The British Heart Foundation, Cancer Research UK, Economic and Social Research Council, Medical Research Council, the National Institute for Health Research and the Wellcome Trust, under the auspices of the UK Clinical Research Collaboration, provided funding (CEDAR grant numbers ES/G007462/1, 087636/Z/08/Z and MR/K023187/1).
Author information
Affiliations
Contributions
RFH, MAT and FK had the initial idea for the study and led the writing of the grant with significant contribution from SM, LD, PC, MC and EvS. All authors were involved in the design of the study. RC, PB, MAT and RH were involved in school and participant recruitment. RC, PB, RO, MAT and RH were involved in data collection and analysis. All authors were involved in the interpretation of the data. All authors provided substantial comments on the drafts of the manuscript and approved the final version.
Corresponding author
Correspondence to Ruth F. Hunter.
Ethics declarations
Ethics approval and consent to participate
Ethical approval was granted by the School of Medicine, Dentistry and Biomedical Science Ethics Committee, Queen’s University Belfast (Ref: 15.09).
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Corepal, R., Best, P., O’Neill, R. et al. A feasibility study of ‘The StepSmart Challenge’ to promote physical activity in adolescents. Pilot Feasibility Stud 5, 132 (2019). https://doi.org/10.1186/s40814-019-0523-5
Received:
Accepted:
Published:
Keywords
- Physical activity
- Intervention
- Behaviour change
- Feasibility
- Adolescents
- Schools
- Mixed methods
- Randomised controlled trial
- Gamification
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.