Assessing the feasibility of evaluating and delivering a physical activity intervention for pre-school children: a pilot randomised controlled trial
Pilot and Feasibility Studies volume 2, Article number: 12 (2016)
Few evidence-based physical activity interventions for pre-school children are available. This two-armed pilot cluster randomised controlled trial aimed to evaluate the feasibility of conducting a full-scale trial and of delivering an outdoor physical activity intervention for pre-school children.
School was the unit of randomisation, and follow-up occurred at 10 and 52 weeks. Trial feasibility was assessed by recruitment, retention and completion rates of primary (daily moderate-to-vigorous physical activity (MVPA)) and secondary (anthropometric, quality of life, self-efficacy) outcomes. Potential effectiveness was assessed for the primary outcome using a linear regression model comparing MVPA between trial arms adjusting for clustering by school. Feasibility of delivering the intervention was assessed by intervention fidelity and attendance. Semi-structured interviews with parents, intervention facilitators, and head teachers explored acceptability and capability to deliver the intervention as well as acceptability of the study design.
Recruitment rates were 37 % of schools (n = 10 schools) and 48 % of pre-school children (n = 164 children). Retention of children to the trial at 52 weeks was 83.5 %. Thirty-nine percent of children had valid primary outcome accelerometer data at baseline and 52 weeks. Response rates for secondary outcome measures ranged from 52 to 88 % at 10 weeks and 59 to 80 % at 52 weeks. The mean difference in daily MVPA between trial arms at 52 weeks was 0.4, 95 % CI 16.3 to 17.0; p = 0.96. Fidelity of intervention implementation was 81 %. Intervention attendance was higher (82 %) during the summer initiation phase compared to autumn/spring initiation (50 %). Parents, facilitators and head teachers found the intervention acceptable and beneficial.
Recruitment and retention rates suggest a trial in this outdoor setting with this population was feasible but is weather sensitive. However, strategies to increase accelerometer wear-time would need to be implemented for reliable primary outcome data to be obtained. There was high implementation fidelity by facilitators, and the intervention was seen as acceptable and deliverable. However, attendance was low and preliminary data showed no evidence of intervention effectiveness. A revised intervention, building on the successful elements of this pilot alongside adapting implementation strategies to improve attendance, should therefore be considered.
Trial registry name and number: Current Controlled Trials, ISRCTN54165860. Date of registration: 4 September 2012.
Regular physical activity has important health and social implications for pre-school children including the promotion of healthy weight [1–4], development of bone and muscle and motor skills, improved social competence [5, 6] and reduction of cardiovascular disease risk [6–8]. There are distinct inequalities in physical activity for ethnic minority groups , and since levels of physical activity track into adulthood [10, 11], this disparity may translate into lifelong inequalities.
In 2011, the UK’s Chief Medical Officer published the ‘Start Active, Stay Active’ report  highlighting the need for activities to promote movement in the early years and recommending investment in community-level programmes in settings such as school playgrounds. However, there are very few effective, evidence-based programmes available for commissioning and none to the authors’ knowledge in the UK. In 2013, a meta-analysis of physical activity interventions for pre-schoolers (mean age 4.1 years) was published . This analysis showed a small-to-moderate short-term effect of intervention on total physical activity (Hedges g = 0.44, SD = 0.86) and a moderate short-term effect on moderate-to-vigorous physical activity (MVPA) (Hedges g = 0.51, SD = 0.88) . A further systematic review of physical activity and obesity prevention interventions in ethnic minority groups reported that none have been conducted in South Asian pre-school populations . Two recent interventions, one in Germany and one in Belgium, have reported small increases in physical activity levels or reductions in sedentary behaviours which have been sustained over a longer term (6–12 months) [15, 16]. These results are promising; however, they may not be clinically meaningful given that the changes were small (less than 10 min difference in MVPA). Furthermore, the intervention in Belgium only reported a positive effect of the intervention upon boys and children of a high socioeconomic status . Therefore, the development of pre-school physical activity interventions which focus on increasing physical activity levels in groups particularly at risk of low levels including low socioeconomic status children and ethnic minority groups is a pressing public health priority. In response, the pre-schoolers in the playground (PiP) intervention was developed. The process used to develop the intervention included focus groups with parents and consultation with early years workers. The process is described in detail elsewhere .
This pilot cluster randomised controlled trial (RCT) aimed to evaluate the feasibility of conducting a full-scale trial and of delivering an outdoor physical activity intervention for pre-school children, ‘PiP’, in a deprived multi-ethnic population. Potential cost-effectiveness was also assessed (reported elsewhere; ). The specific objectives were to determine (1) trial feasibility (recruitment, retention, feasibility of collecting outcome measures, preliminary assessment of intervention effectiveness) and (2) intervention feasibility (intervention fidelity, attendance, acceptability to parents, facilitators and head teachers and capability of the school to deliver the intervention).
The study was a two-armed pilot cluster RCT, comparing the PiP intervention and a usual practice (control) arm. The reporting of this trial follows the CONSORT statement recommendations . The CONSORT checklist is provided as supplementary information, and the diagram is presented in Fig. 1. Recruitment, randomisation and implementation took place in three waves. Wave 1 commenced in the autumn of 2012, wave 2 in winter 2013 and wave 3 in summer 2013. The recruitment target was ten schools in the two poorest quintiles of index of multiple deprivation in the city of Bradford, UK, and 150 children aged 18 months to 4 years who were affiliated to these schools (attending feeder nurseries, children’s centres or with older siblings at the school). Recruitment was through letters sent home with school-going children attending the trial schools. Additionally, community research assistants recruited families through face-to-face conversations with parents or guardians in the playground at schools, children’s centres and nursery sites. To account for the linguistic diversity among the study population, research assistants recruiting families and subsequently conducting measurements and questionnaires were bilingual and undertook these tasks in either English or Urdu. The only exclusion criterion was if the parent or legal guardian was unable to provide consent. Schools were allocated on a 1:1 basis to either intervention or control. Randomisation was conducted by York Trials Unit randomisation service using a secure computer system after baseline data were collected. For wave 1, an even number of schools had to be allocated to the intervention and control, and so, block randomisation was used during this run in period. The subsequent six allocations (for waves 2 and 3) were achieved via minimisation to ensure balance of predominantly White and South Asian schools in the intervention and control arms. At least four clusters per arm are recommended for a cluster RCT to provide clear estimates of recruitment and follow-up ; the sample size thus exceeds recommendations for pilot trials . Follow-up occurred at 10 and 52 weeks after the start of the intervention, finishing in May 2014. All outcomes were collected at each time point for participants in the intervention arm and the control arm. It was not possible for schools, participants and facilitators to be blind to allocation because of the nature of the intervention. It was planned that researchers would be blind to allocation; however, many of the parents informed staff of their child’s trial status. It was also planned that the statistician and health economist would be blind to allocation; however, due to staffing complications, an unblinded statistician conducted the statistical analyses.
Consent and ethical approval
The study was ethically approved by the NRES committee Yorkshire and the Humber (12/YH/0334). Prior to participation, parents gave written informed consent for their own and their child’s engagement in the research. Head teachers and intervention facilitators also gave written informed consent for their participation in research interviews.
PiP intervention arm
The intervention was delivered in primary school playgrounds at specific times to coincide with when school aged children were delivered to or collected from school, as identified by the school. Six 30-min PiP sessions per week were available for 30 weeks, and families were encouraged to attend three sessions a week. The initiation phase (10 weeks) was facilitated by a member of school staff. Each session included two 5-min structured-play activities for parents and children to engage in together (detailed in a manual), 15 min of free play (during which handouts were given and guided discussions conducted with parents) and an active tidy-up . Children received a free piece of play equipment each week to take home and keep; the value of the whole play kit totalled £15. During the maintenance phase (20 weeks), playgrounds remained available six times a week for 30 min, but sessions were not supervised by school staff.
Families in the control arm did not have access to a playground intervention and continued with their daily routines as normal.
Recruitment and retention
Data relating to recruitment (number of schools and participants approached, excluded, agrees to further contact and consented) and retention (number of participants who withdrew, were lost to follow-up or who provided data) were captured using a central database. Parents and children attended measurement sessions either at participating schools or in their own homes at baseline, 10 weeks and 52 weeks.
Parents were asked to place an ActiGraph GT3X+ accelerometer (ActiGraph Pensacola Florida, USA) on a waistbelt on their child (right anterior iliac crest) during waking hours for 7 days. Parents were asked to complete a wear-time log, detailing when the accelerometer was worn and removed; a reward sticker chart was given to the child to support them to wear the accelerometer. Raw count data was processed using ActiLife version 6 software (ActiGraph Pensacola Florida, USA) and integrated to 15 s epochs. Non-wear was considered to be consecutive zero counts of ≥10 min. A valid wear-time was considered to be any 3 days with ≥6 h of wear. Pate cut points  were used to estimate daily moderate-to-vigorous physical activity (MVPA; primary outcome), total and light physical activity, and sedentary time.
Children’s height and weight were measured in lightweight clothing using a Leicester height measure (Harlow Healthcare, UK) and Seca electronic scales (Medical scales and measuring systems, UK). Body mass index (BMI) was calculated and converted to age- and sex-adjusted z-scores relative to WHO 2006  growth standards using the least-mean-squared method. Upper arm circumference was measured at the midpoint between the acromion process and olecranon process. Waist circumference was measured at the midpoint between the lowest rib and iliac crest.
Parents completed the pediatric quality of life scales (infant or toddler scale depending on age of child) , the EQ5D-3L (parent quality of life measure) , ComQol-A5  (parent well-being measure) and the general self-efficacy scale . Parents also reported their child’s health and social care use (details of this are provided elsewhere; ). All questionnaires were completed electronically on tablet computers to minimise missing data or multiple answers. Families received a £10 gift voucher for attending measurement sessions.
Intervention implementation fidelity was assessed according to NIH Behavior Change Consortium guidance ; eight intervention sessions (≥1 at each school) were observed and fidelity scores relating to five key intervention factors (refer to Table 5) recorded.
Attendance to sessions and intervention harms
Participant attendance at intervention sessions was recorded at each session by the facilitator. Any accidents or injuries resulting from the intervention were to be recorded by the facilitator.
Trial and intervention acceptability
Semi-structured interviews (a mix of face-to-face and telephone) were conducted with 15 parents from both trial arms (n = 10 intervention, n = 5 control), seven PiP facilitators and two head teachers from the intervention arm (see Table 1). For parents, a maximum variation sampling strategy  was employed to achieve diversity on three key characteristics: ethnicity, number of intervention sessions attended and parent (mother or father). All interviews were conducted in English and audio-recorded digitally. Parents were interviewed after completing their 10-week follow-up session and received a £10 gift voucher on completion of the interview. PiP facilitator interviews were also conducted at the 10-week follow-up, and head teachers were interviewed at the 52-week follow-up time point. Topics covered in the interview included acceptability of recruitment, study design and using the accelerometers (parents); views about intervention attendance (all) and intervention content (parents and facilitators); and schools’ capability and capacity to deliver the intervention (facilitators and head teachers). Interviews with parents lasted between 6 and 19 min. Facilitator interviews lasted between 13 and 31 min, and head teachers’ interviews lasted between 12 and 16 min.
As this was a pilot trial, the analyses were mainly descriptive. For both trial arms, the numbers of schools and children approached, randomly assigned, receiving PiP or control, attending intervention sessions (intervention arm only) and providing outcome data for both the primary and secondary outcomes were summarised. Baseline, 10-week and 52-week follow-up data for primary and secondary outcomes were also summarised.
An analysis of the primary outcome to mimic practice in a full-scale trial was undertaken in Stata v12 using the intention-to-treat principle. School was the unit of analysis and children’s mean MVPA/day, the outcome variable. A weighted linear regression model compared the two arms weighted by the number of participants followed up in each cluster and adjusted for the baseline average MVPA/day for each cluster. A cost-effectiveness analysis was also conducted, and this is reported elsewhere .
Qualitative data analysis
Audio recordings were transcribed verbatim with anonymisation of all personal data. These interview data were then analysed using thematic analysis which is a useful approach for producing qualitative analyses suited to informing the policy and programme development . The six phases of thematic analysis were followed (familiarisation, generating initial codes, searching for themes, reviewing themes, defining and naming themes and producing the report ). The three data sets (parents, facilitators and head teachers) were analysed independently. The Atlas-ti software package facilitated data management.
Recruitment and retention
Figure 1 shows participant flow through the trial. Twenty-seven schools were approached to take part in the study. Ten (37 %) consented and were randomised to the intervention or control arms (six with predominantly South Asian pupils and four with predominantly White pupils). Three hundred and forty-one children were screened for inclusion in the study, and no children were excluded from participating based on parent/guardian incapacity to consent. The parents of 305 (89 %) of these children agreed to be contacted further about the study, and 164 (48 %) children were ultimately consented to take part in the study. Nine (5.5 %) children withdrew from the trial, 27 (16.5 %) were lost to follow-up (providing no accelerometer data) and 137 (83.5 %) were retained in the trial (providing any data) at 52 weeks.
Demographics of the 164 trial participants are shown in Table 2. The average age of the children recruited was 2.8 ± 0.7 years. The number of boys and girls was similar (77 and 85, respectively), and there were more children of South Asian ethnicity than children of White ethnicity recruited into the trial (93 and 60, respectively). At baseline, mean MVPA for all children (intervention and control) was 63.6 ± 25.0 min per day and mean total PA was 285.0 ± 54.7 min per day. Ninety-six per cent of children met the guidelines of 180 min of total physical activity a day, and 35.7 % were considered overweight according to their BMI z-score. Randomisation achieved balance across age, sex and parental ethnicity. Attrition did not impact on the balance achieved at baseline in the ‘as analysed’ sample (i.e. those included in the primary analysis—those providing both baseline and 52-week MVPA data regardless of fidelity).
At baseline, 113 (69 %) children returned valid accelerometer data. Sixty-four (39.0 %) children had MVPA data at baseline and 52-week follow-up and were included in the primary analysis.
Table 3 shows that the intervention arm appears to be undertaking slightly less MVPA, more light activity and be more sedentary compared to the control arm at 52-week follow-up. The minutes in total physical activity and the percentage of children undertaking 180 min of physical activity a day were higher in the intervention at 10 weeks but similar at 52 weeks. At 52 weeks, the adjusted mean daily MVPA was 75.6 (95 % CI 63.4 to 87.8) in the intervention and 75.2 (95 % CI 64.2 to 86.3) minutes in the control arm (mean difference 0.4, 95 % CI 16.3 to 17.0, p = 0.96).
Table 4 shows anthropometric outcomes alongside well-being and self-efficacy total scores. Response rates for secondary outcomes ranged from 52 to 88 % at 10 weeks and from 59 to 80 % at 52 weeks. There was little difference in average body mass and height between the intervention and control arms at either follow-up point. At 10 weeks, the average BMI z-value in the intervention arm was slightly lower at 0.5 (SD 1.2) than in the control arm which was 0.7 (SD 1.2); values at 52 weeks were more similar. The average waist and arm circumference were slightly lower in the intervention arm than in the control arm at both time points. In terms of well-being, the overall objective score was lower in the intervention arm at both time points [10 weeks: intervention 72.7 (SD 9.2), control 74.0 (SD 6.7); and 52 weeks: intervention 72.4 (SD 7.5), control 74.5 (SD 7.1)]. However, there was little change in scores between the two time points. Self-efficacy scores were similar between allocated arms at both time points [10 weeks: intervention 31.1 (SD 6.4), control 30.9 (SD 5.0); and 52 weeks: intervention 31.8 (SD 5.5), control 31.9 (SD 4.3)].
The mean total fidelity score was 29.1 (SD 5.7), out of a total possible score of 36, highlighting overall good adherence (81 %) to the intervention protocol. Two factors that had poorer adherence were ‘Encouraging families to seek other physical activities on non-intervention days’ and providing ‘Information on guidelines for physical activity for under 5’s’ (Table 5).
Attendance to sessions and intervention harms
There were no accidents of or injuries related to the intervention reported by the PiP facilitators. Table 6 displays attendance at PiP sessions. Attendance was markedly higher during the summer-term initiation phase and greater among South Asian children (mean 11.3, SD 11.8; median 4.5, min 1 to max 35) compared to White children (mean 10.7, SD 12.1; median 3, min 1 to max 33). Attendance was also much higher in the initiation phase compared to the maintenance phase. It was recommended that children attend 30 sessions in the initiation and 60 in the maintenance phase (n = 90 overall). No schools delivered the second term of the maintenance phase, so the maximum number of sessions that families could have attended (initiation plus maintenance) was 60.
Trial and intervention acceptability
Acceptability of recruitment and study design
In the interviews, parents were generally positive about being approached in the playground to take part in the study, and this appeared to be associated with the friendly manner of the community research assistants and the assumption that the school/nursery/children’s centre had endorsed the PiP study.
I don’t usually like being approached by people in town. This was OK as was in the school playground so you are more trusting.
P01—control, wave 1, father, White
Two parents for whom English was not their first language said they had been unable to read the study information sheet but that the community research assistant had explained the study to them verbally, which had helped with their understanding.
Yeah, because I am, sorry, but I’m tell her, I said my reading problem, I’m not properly read, but I said you some explain and I understand what she said.
P02—control wave 2, mother, Pakistani
Other parents commented that the study information was clear both from the conversation with the community research assistant and in the written information that they were given to take home.
Many of the parents, however, were confused about the concept of randomisation and its implication for their participation; for example one parent thought that the schools with the most children were chosen for the PiP intervention.
I thought the most school that had the most parents, that’s why they got chosen [for the PiP intervention].
P13—intervention, wave 2, mother, White, attended no PiP sessions
Acceptability of accelerometry
Most parents said that using the accelerometer belt was easy and generally described their child as ‘being fine’ or enjoying wearing the belt.
Yeah, he loves the belt… it’s easy when you put it on in the morning, but when you take it off in the night it’s, it’s hard because he says, oh I have to leave it on… but when he’s gone to sleep I just pull it off.
P13—intervention, wave 3, mother, Pakistani, attended most PiP sessions
Some parents mentioned difficulties in using the belt, namely they forgot to put it on the child, the belt either moved or pinched the child when tight and a small part of the accelerometer kept falling off (and could be swallowed by the child).
Quite often you’ve got to move it back into place, cause if she’s moving about and stuff, it’s moving. So it does need summat a bit more so it’ll stay in that spot. The other problem is it, it’s got small parts on it, as well, that come off.
P10—intervention, wave 2, father, White, attended one PiP session
Views about intervention attendance
A variety of reasons were offered by parents and facilitators for poor attendance to the PiP sessions. Some of these were family issues and unrelated to PiP, for example child and family illness. The timing and location of the PiP sessions were discussed by several parents as a barrier to attendance, particularly in the context of their children’s routines (nap and nursery times).
My daughter is in Nursery until 11.45 and then she needs to nap when gets home, so hard to get to afternoon session. This term I will ask Nursery if I can take her out 20 minutes in the morning to do the exercise, should be ok as it’s at the same place.
P05—intervention, wave 1, mother, White, attended a few PiP sessions
Whereas for the parents who attended regularly, the timings and location worked as anticipated, linking with school drop-off and pick-up. One of the facilitators described how one mum had ‘made it work’ by doing two sessions on one day each week to fit all three sessions in around her employment.
The bad weather was discussed by all seven parents in waves 1 and 2 (autumn and winter initiation phases) and offered as a reason for why ‘other parents and children’ may not have attended. Facilitators and head teachers also talked about the negative influence of the weather suggesting that it was to be expected that parents did not return when they had been outside in ‘freezing’ weather. A facilitator in wave 3 described the opposite problem of parents not bringing their children as it was too hot.
The attendance was a problem cause of the time of the year. The weather played a huge, a major factor in the parent, getting the parents to attend. Any adverse weather and attendance fell there. If a similar project was to be run again it would be better in the summer.
H01, wave 1, South Asian school
The facilitators offered some additional reasons why they thought the parents had not attended PiP sessions; these included a lack of promotion of the study at the school, the ‘burden’ of the measurement sessions, unfamiliarity with the facilitator, feeling embarrassed being watched doing the PiP sessions on the playground, the challenge of bringing two children to the sessions and a nervousness and reluctance by parents to take part in school activities. Both of the head teachers spoke about children who would most benefit from attending being the ones whose families are most difficult to engage in school activities generally.
Finally, two facilitators were not confident that the ‘maintenance’ sessions would work without them being there because they believed that someone needed to take the lead. A different two were more positive because they thought that there were some parents who were regular attenders who were very capable of running the sessions, but they were less sure that parents with less confidence would continue to attend.
And you know it’s on and you know it’s there, because they can see me out on the playground, cause most of them know me anyway from other things, and I think they just feel like there’s someone there to guide them really.
W04—wave 1, White school
Acceptability of intervention content
Five of the nine parents in the intervention arm who were interviewed had attended any PiP sessions, and two of these had attended most sessions (and provide the most detail about the sessions). The other three had attended less than five sessions. Four of the five parents and all of the facilitators were very positive about the PiP sessions. They saw them as fun for the children and commented on the variety of games and equipment that the children had enjoyed playing with both in the sessions and then at home. In contrast, one parent reported a negative experience of the intervention and only attended one session, explaining that the facilitator was not confident in delivering the session.
We have enjoyed ourselves. It’s like every week it was something different. Something different every day and my (name of child) loves playing with balls and the cricket bat.
P13—intervention, wave 3, mother, Pakistani, attended most PiP sessions
Because I’m dragging the equipment up before me, they do a little bit of free play before we begin even. They’ve normally started kicking the ball, they just do, they don’t in the beginning the first few weeks they’ve probably hung around and waiting for me to start, now as soon as there’s a ball or a hoop, they’re off basically.
F05—wave 3, White school
The two parents who had frequently attended the sessions identified how their children had developed over the 10 weeks, not only in initiating playing active games but also in developing confidence, learning colours, sharing toys with other children and making friends with children who would also be starting nursery in the following September.
When she started she was very clingy, you know she wouldn’t do anything, she wouldn’t move around, she just wanted to hold me and look, she was interested in what the other children were doing, she wasn’t doing it herself, but over the weeks, so I’ve noticed the change in her. So you know she’s picking the bean bag up, she loves the beanbag.
P14—intervention, wave 3, mother, Pakistani, attended most PiP sessions
Parents and facilitators also spoke about benefits to the parents of attending the sessions; these included making new friends, enjoying doing something with their child, being more active themselves and learning how to do active play with their child at home.
When we model it from the first session it’s getting to, used to it, and then eventually they (the parents) would know what to do. The more we did we had more fun, I think because we were getting more confident at delivering it and the parents were getting more confident with us as well, yeah and the kids.
F02b—wave 1, South Asian school
Capability and capacity to deliver the intervention
Both head teachers described how they had incorporated the work into the staff’s existing workloads. One viewed this as a cost to the school and commented that in order for the intervention to continue, external staff would be required to deliver the sessions.
We provided a couple of members of staff to keep the project running… It did take ‘em away from their normal job… On the whole, the project did impact on children and staffing at (name of school). (The research team) would need to provide more staff in the future should the project run again.
H01—wave 1, South Asian school
The other described how the school was well staffed with a good budget so this was less of a concern. However, she explained that parents at her school do not ‘stick with’ any initiatives for very long, so a shorter programme may be more sustainable.
Recruitment of schools to the trial (10/27, 37 % uptake) was similar to another school-based physical activity intervention (41 % uptake) , and recruitment of families (164/341, 48 % uptake) was marginally better than other similar studies (39–42 % uptake) [16, 31, 32]. Retention was also better than other similar trials with 83.5 % at 52 weeks compared to 68 and 75 % at 12 weeks . At baseline, 113 (69 %) children returned valid accelerometer data; however, those who provided valid data at both baseline and 52 weeks was lower (n = 64, 39 %). This aligns with similar RCTs in older pre-school children (mean age ~5 years), where 42 to 70 % of children returned valid accelerometer data at both baseline and follow-up [15, 16, 34]. The interview data from parents suggested that the recruitment strategy was acceptable; however, parents did not understand the concept of randomisation. Accompanying written information in the participant information sheet with a visual description pictorially or via an online video may help parents to better grasp this concept. The accelerometers were acceptable for most children. To enhance the safety of using the accelerometers with very young children, we suggest encapsulating the monitors in a waterproof adhesive dressing (such as Tegaderm™) to prevent small parts being accessed. Ways to improve wear-time could include improving communication to parents that the belts can be worn over clothing to prevent pinching and providing daily morning telephone calls/text messages to parents, reminding them to fit the belts to their children.
Attendance was greater during the summer initiation phase when the weather was dryer and warmer. The interview data showed clearly that the weather and associated child sickness in the colder months impacted on attendance. Parents, facilitators and head teachers all recommended a summer-term only intervention. Attendance was also poor during the maintenance phase, with facilitators suggesting this may be due to the lack of their presence in the playground. Indeed, previous research has shown that teacher-led interventions are more effective than parent-led interventions for pre-school children . Furthermore, one head teacher said that with the maintenance phase the intervention became too long for parents to engage with. Based on the interview data, several modifications to the intervention and strategies to maximise attendance are proposed. These are as follows: a shorter, 10-week (one term) summer-time-only intervention, delivered by a facilitator, with more visible promotional materials, reminders to attend and incentives for parents (healthy refreshments and social time).
Despite the low attendance rates overall, parents, facilitators and head teachers all commented that the intervention was beneficial to children, parents and schools. These benefits were not directly related to physical health, rather, learning, developing social and communication skills and building up relationships between families and schools. Gordon et al.’s  recent meta-analysis of physical activity interventions for pre-school children emphasised the importance of the delivery site and showed that effective interventions were delivered in a learning environment (usually a pre-school setting), whereas home-based interventions were associated with a small negative effect upon indices of physical activity. This highlights the importance of using school/pre-school sites for health promotion. Emphasising the benefits that health interventions may have to learning and learning environments may increase the willingness of these settings to engage with and deliver health interventions.
Previous pre-school physical activity trials rarely report on the fidelity of the intervention. One teacher-led pre-school structured-play physical activity intervention from the USA  reported an average of 70 % adherence across different domains included in their analysis (duration of sessions and delivery according to instructions). In the current study, fidelity of the intervention was good indicating that it was feasible for schools to deliver the intervention. The two components with poorer adherence in the PiP intervention were ‘providing information on guidelines for physical activities for the under 5’s’ and ‘encouraging families to seek other physical activities’. These two components should have been covered in the guided discussion and handouts section of the PiP sessions which parents recalled little information about. Changing the way that this information is delivered, perhaps via short information video clips, may be one way to meet these intervention objectives.
For the qualitative aspect of the study, there was good representation from parents and from the school staff who were delivering the intervention. Head teachers were more difficult to engage in the interviews with only two from the five intervention schools taking part. In future work, we suggest that head teachers delegate liaison with the PiP research team to a member of their senior staff with particular responsibility for physical activity, for example the PE coordinator. The two schools where the head teachers were interviewed had different views on the capacity of their schools to deliver the intervention. Both had incorporated the delivery of the intervention into the workloads of existing staff. In one school, the facilitators were nursery staff, and in the other school, the facilitator was a parental involvement worker whose role is to work with and support families. This seemed to be a more appropriate member of staff to facilitate the intervention as it was more easily incorporated into their workload. In future, these members of staff would be sought to deliver the intervention. In addition, leverage can be sought with the new English schools inspection monitoring criteria (Ofsted) coming into force in all school levels (including early years settings) in September 2015, which will include a new judgement criterion focus on school promotion of physical activity and physical activity-related policies .
The current study has both strengths and limitations. The pilot trial used a multi-method approach (quantitative, qualitative and health economic analyses); thus, a thorough evaluation of the feasibility of both conducting a trial and delivering the PiP intervention has been conducted. The study was successful at engaging hard-to-reach White and ethnic minority families living in areas of high deprivation, groups which are often underrepresented in research. There were good recruitment and retention rates. However, a relatively low number of participants were included in the analysis of data because few had accelerometry data at baseline and 52-week follow-up. Where families are living with financial pressures, putting an accelerometer on their child may not be a priority. This is a limitation of the pilot trial, and interview data from the current study offers potential solutions to increase wear-time. There were poorer-than-expected attendance rates to the intervention, and consequently, the data relating to the effect of the intervention on health outcomes may not reflect the likely effect of the proposed modified intervention.
Recruitment and retention rates suggesting a full-scale trial in this outdoor setting with this population would be feasible. In order for reliable primary outcome data (habitual physical activity) to be obtained, strategies to increase accelerometer wear-time would need to be implemented in a full trial. Preliminary data showed no evidence of intervention effectiveness and low intervention attendance rates. However, there was high implementation fidelity by facilitators, and the intervention was seen as acceptable and deliverable. A revised intervention building on successful intervention elements and incorporating strategies to improve attendance should therefore be considered.
Janz KF, Kwon S, Letuchy EM, Eichenberger Gilmore JM, Burns TL, et al. Sustained effect of early physical activity on body fat mass in older children. Am J Prev Med. 2009;37:35–40. http://dx.doi.org/10.1016/j.amepre.2009.03.012.
Epstein LH, Paluch RA, Gordy CC, Dorn J. Decreasing sedentary behaviors in treating pediatric obesity. Arch Pediatr Adolesc Med. 2000;154:220–6. http://dx.doi.org/10.1001/archpedi.154.3.220.
Department of Health. At least five a week: evidence on the impact of physical activity and its relationship to health. URL: http://www.bhfactive.org.uk/sites/Exercise-Referral-Toolkit/downloads/resources/cmos-report-at-leastfive-a-week.pdf (accessed 15 Feb 2016).
Martinez-Gomez D, Eisenmann JC, Tucker J, Heelan KA, Welk GJ. Associations between moderate-to-vigorous physical activity and central body fat in 3–8-year-old children. Int J Pediatr Obes. 2011;6:e611–4. http://dx.doi.org/10.3109/17477166.2010.533775.
Gortmaker SL, Peterson K, Wiecha J, Sobol AM, Dixit S, Fox MK, et al. Reducing obesity via a school-based interdisciplinary intervention among youth: planet health. Arch Pediatr Adolesc Med. 1999;153:409–18. http://dx.doi.org/10.1001/archpedi.153.4.409.
Timmons BW, LeBlanc AG, Carson V, Connor Gorber S, Dillman C, Janssen I, et al. Systematic review of physical activity and health in the early years (aged 0–4 years). Appl Physiol Nutr Metab. 2012;37:773–92. http://dx.doi.org/10.1139/h2012-070.
Shea S, Basch CE, Gutin B, Stein AD, Contento IR, Irigoyen M, et al. The rate of increase in blood pressure in children 5 years of age is related to changes in aerobic fitness and body mass index. Pediatrics. 1994;94:465–70.
Sääkslahti A, Numminen P, Varstala V, Helenius H, Tammi A, Viikari J, et al. Physical activity as a preventive measure for coronary heart disease risk factors in early childhood. Scand J Med Sci Sports. 2004;14:143–9. http://dx.doi.org/10.1111/j.1600-0838.2004.00347.x.
Fischbacher CM. How physically active are south Asians in the United Kingdom? A literature review. J Public Health. 2004;26:250–8. http://dx.doi.org/10.1093/pubmed/fdh158.
Shankaran S, Bann C, Das A, Lester B, Bada H, Bauer CR, et al. Eunice Kennedy Shriver National Institute of Child Health and Human Development Neonatal Research Network. Risk for obesity in adolescence starts in early childhood. J Perinatol. 2011;31:711–6. http://dx.doi.org/10.1038/jp.2011.14.
Herman KM, Craig CL, Gauvin L, Katzmarzyk PT. Tracking of obesity and physical activity from childhood to adulthood: the Physical Activity Longitudinal Study. Int J Pediatr Obes. 2009;4:281–8. http://dx.doi.org/10.3109/17477160802596171.
Department of Health. Start active, stay active. URL www.gov.uk/government/uploads/system/uploads/attachment_data/file/216370/dh_128210.pdf (accessed 15 Feb 2016).
Gordon ES, Tucker P, Burke SM, Carron AV. Effectiveness of physical activity interventions for preschoolers: a meta-analysis. Res Q Exerc Sport. 2013;84:287–94. http://dx.doi.org/10.1080/02701367.2013.813894.
Brown T, Smith S, Bhopal R, Kasim A, Summerbell C. Diet and physical activity interventions to prevent or treat obesity in South Asian children and adults: a systematic review and meta-analysis. Int J Enviro Res and Public Health. 2015;12:566–94. http://doi.org/10.3390/ijerph120100566.
De Bock F, Genser B, Raat H, Fischer JE, Renz-Polster H. A participatory physical activity intervention in preschools: a cluster randomized controlled trial. Am J Prev Med. 2013;45:64–74. http://dx.doi.org/10.1016/j.amepre.2013.01.032.
De Craemer M, De Decker E, Verloigne M, De Bourdeaudhuij I, Manios Y, Cardon G. ToyBox study group. The effect of a kindergarten-based, family-involved intervention on objectively measured physical activity in Belgian preschool boys and girls of high and low SES: the ToyBox-study. Int J Behav Nutr Phys Act. 2014;11:38. http://dx.doi.org/10.1186/1479-5868-11-38.
Barber SE, Jackson C, Akhtar S, Bingham DD, Ainsworth H, Hewitt C, et al. ‘Pre-schoolers in the playground’ an outdoor physical activity intervention for children aged 18 months to 4 years old: study protocol for a pilot cluster randomised controlled trial. Trials. 2013;14:326. http://dx.doi.org/10.1186/1745-6215-14-326.
Barber S, Akhtar S, Jackson C, Bingham D, Hewitt C, Routen A, et al. Preschoolers in the playground: a pilot cluster randomised controlled trial of a physical activity intervention for children aged 18 months to 4 years. Public Health Res. 2015;3(5). http://www.ncbi.nlm.nih.gov/books/NBK293651/.
http://www.consort-statement.org. Accessed on 7/12/2015
Murray DM. Design and analysis of group-randomized trials. Oxford: Oxford University Press; 1998.
Julious SA. Sample size of 12 per group rule of thumb for a pilot study. Pharm Stat. 2005;4:287–91.
Pate RR, Almeida MJ, McIver KL, Pfeiffer KA, Dowda M. Validation and calibration of an accelerometer in preschool children. Obesity. 2006;14:2000–6. http://dx.doi.org/10.1038/oby.2006.234.
Multicentre Growth Reference Study Group WHO. WHO child growth standards: length/height-for-age, weight-for-age, weight-for-length, weight-for-height and body mass index-for-age: methods and development. Geneva: WHO; 2006. p. 229–300.
Varni JW, Limbers CA, Neighbors K, Schulz K, Lieu JEC, Heffer RW, et al. The PedsQL™ infant scales: feasibility, internal consistency, reliability and validity in healthy and ill infants. Qual Life Res. 2011;20:45–55. http://dx.doi.org/10.1007/s11136-010-9730-5.
Janssen MF, Pickard AS, Golicki D, Gudex C, Niewada M, Scalone L, et al. Measurement properties of the EQ-5D-5L compared to the EQ-5D-3 L across eight patient groups: a multicountry study. Qual Life Res. 2012;7:1717–27. http://dx.doi.org/10.1007/s11136-012-0322-4.
Cummins RA. The comprehensive quality of life scale: development and evaluation. Presented at the Health Outcomes and Quality of Life Measurement Conference, Canberra, 14–15 August 1995. Reprinted Health Outcomes Bulletin. 1995;7:7–14.
Schwarzer R, Jerusalem M. Generalized self-efficacy scale. In: Weinman J, Wright S, Johnston M, editors. Measures in Health Psychology: A User’s Portfolio. Causal and Control Beliefs. Windsor: NFER-NELSON; 1995. p. 35–7.
Bellg AJ, Borrelli B, Resnick B, Hecht J, Minicucci DS, Ory M, et al. Treatment Fidelity Workgroup of the NIH Behavior Change Consortium. Enhancing treatment fidelity in health behaviour change studies: best practices and recommendations from the NIH Behavior Change Consortium. Health Psychol. 2004;23:443–51. http://dx.doi.org/10.1037/0278-6188.8.131.523.
Patton MQ. Qualitative evaluation and research methods. 2nd ed. Newbury Park, California: Sage; 1990.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3:77–101.
Nieto FJ, Szklo M, Comstock GW. Childhood weight and growth rate as predictors of adult mortality. Am J Epidemiol. 1992;136:201–13.
O’Dwyer MV, Fairclough SJ, Knowles Z, Stratton G. Effect of a family focused active play intervention on sedentary time and physical activity in preschool children. Int J Behav Nutr Phys Act. 2012;1:117. http://dx.doi.org/10.1186/1479-5868-9-117.
Hesketh KD, Campbell KJ. Interventions to prevent obesity in 0–5 year olds: an updated systematic review of the literature. Obesity. 2010;18 Suppl 1:S27–35. http://dx.doi.org/10.1038/oby.2009.429.
O’Dwyer MV, Fairclough SJ, Ridgers ND, Knowles ZR, Foweather L, Stratton G. Effect of a school-based active play intervention on sedentary time and physical activity in preschool children. Health Educ Res. 2013;28:931–42. http://dx.doi.org/10.1093/her/cyt097.
Alhassan S, Whitt-Glover MC: Intervention fidelity in a teacher-led program to promote physical activity in preschool-age children. Prev Med. 2014 Jul 24. doi: 10.1016/j.ypmed.2014.07.024.
http://www.schoolfoodplan.com/wp-content/uploads/2015/02/APPG-School-Food-Letter.pdf accessed on 22/07/2015.
The study was funded by NIHR Public Health Research (PHR 11/3001/16; 13 June 2012) and NIHR CLAHRC Yorkshire and the Humber. They had no role in the study design; collection, analysis and interpretation of data; writing the report; and the decision to submit the report for publication.
The authors declare that they have no competing interests.
SEB managed the trial and is the primary author. CJ was responsible for the qualitative data collection and the analysis, preparation and presentation of the qualitative results. CH conducted the statistical analysis. HA provided the trial support from the York Trials Unit and contributed to writing the design and methodology sections. HB prepared and presented the quantitative results. SA was responsible for the data collection and management. DB managed the accelerometry data collection. AR was responsible for the analysis of the accelerometry data and contributed to writing the physical activity results and discussion. CS contributed to the review of the literature and writing of the introduction and discussion. GR was responsible for the health economic methodology. HM provided expertise in the children’s physical activity interventions and contributed to the analysis and presentation of the physical activity data. KP provided expertise in the health inequalities and contributed to writing the introduction and discussion. CO contributed to the analysis and presentation of the physical activity data. SB provided the link to the practice and made revisions to the discussion section. JW was the PI and had overall responsibility for the study. All authors read and approved the final manuscript.
About this article
Cite this article
Barber, S.E., Jackson, C., Hewitt, C. et al. Assessing the feasibility of evaluating and delivering a physical activity intervention for pre-school children: a pilot randomised controlled trial. Pilot Feasibility Stud 2, 12 (2016). https://doi.org/10.1186/s40814-016-0052-4