- Study Protocol
- Open Access
- Open Peer Review
A classroom-based intervention targeting working memory, attention and language skills in 4–5 year olds (RECALL): study protocol for a cluster randomised feasibility trial
Pilot and Feasibility Studiesvolume 5, Article number: 82 (2019)
There is international recognition of the need for creative, classroom-based interventions to support children at risk of low academic achievement and well-being, due to poor attention and language skills on school entry. Working memory (WM) is a cognitive skill that is strongly associated with attention and language skills. There has been speculation that WM training, embedded within typical educational activities, may improve children’s WM skills and produce transfer effects to real-world skills such as attention and language. However, little is known about the effectiveness of this approach.
‘Recall to Enhance Children’s Attention, Language and Learning’ (RECALL) is a novel, 6-week, classroom-based intervention targeting WM, attention and language skills in 4–5 year olds. RECALL was co-produced with health professionals, teachers and parents. This protocol describes the rationale, methods and analysis plan for a proposed cluster randomised feasibility trial of this RECALL programme.
This is a three-arm, cluster randomised feasibility trial comparing RECALL to an existing programme (active control), and no-intervention (education as usual). We will recruit six schools in socially disadvantaged areas in one region of the UK. Two schools will be randomly allocated to each arm of the trial. In each school, one class of children (ages 4-5 years) of approx. 30 children will be involved in this study. Ten children in each class will be sampled purposefully for outcome measurement including: standardised assessments of WM, language and attention skills; teacher ratings of attention; and parent ratings of functional communication skills. These will be administered at baseline and 1-week post-intervention in order to test the acceptability of the measures. A process evaluation using semi-structured interviews with participants will explore the acceptability of RECALL and the procedures employed in this trial.
This feasibility study will explore the acceptability of RECALL to the health professionals and teachers who will deliver it and inform the optimal design of the programme. The inclusion of an active control group and the blinding of outcomes assessors enhance rigour in this study. The findings will determine whether this study can be scaled-up into a definitive cluster randomised trial to evaluate the effectiveness of RECALL.
ISRCTN13633886. Registered 7 Sept 2018.
Internationally, the need for classroom interventions that break cycles of academic underachievement, unemployment and poor mental and physical health is widely acknowledged . In areas of low socio-economic status (LSES), high proportions of children present with impoverished language skills on school entry, and are subsequently at risk of poor school performance [2,3,4]. To address this, Speech and Language Therapy and other health services provide early intervention in schools through collaborative, classroom-based approaches. However, there is a lack of research-based evidence for the effectiveness of such interventions [5,6,7]. There is now a need for creative, therapeutic interventions to support this population [8, 9].
For children from LSES backgrounds, low language is often associated with cognitive difficulties [10, 11]. Working memory (WM) is a cognitive skill reflecting the ability to hold in mind and mentally manipulate information over short periods of time in the face of distraction [12,13,14]; it is strongly associated with attention skills [15,16,17] and language acquisition . The implication of the symbiotic relationship between WM, attention and language  is that targeting WM as an underlying skill may produce improvements in these real-world skills .
Most research into the effectiveness of WM interventions has investigated computerised training packages (e.g. Cogmed 2005 ). The therapeutic value of this approach has been debated due to the consistently inconsistent evidence for transfer effects, i.e. the generalisation of positive effects on trained tasks to other untrained tasks . In the WM literature, transfer effects have been differentiated into near-transfer and far-transfer. Near-transfer refers to improvements in untrained tasks that are similar to those trained, e.g. improvements in a visuospatial WM task following training on a verbal WM task [23, 24]. Far-transfer refers to enhanced performance in tasks quite different from those trained but which are deemed to be dependent on WM, e.g. improvement on real-world skills including language, literacy, numeracy and the ability to pay attention in class following WM training [23, 24]. The presence of near-transfer effects associated with an intervention is an essential criterion to corroborate any far-transfer effects identified .
On the basis that treatment effects are likely to transfer to activities with overlapping features to the trained task , there have been calls for WM training to be embedded within the typical activities in which benefits are needed [27, 28]. However, there has been limited research into the effectiveness of WM interventions applied with young children in everyday contexts. Furthermore, to date, the literature has focused on the cognitive benefits of WM training, and the individual differences that may moderate or mediate training and transfer effects [29, 30]. There has been little consideration of the contextual factors associated with the delivery of WM interventions in real-life settings such as schools. It has been suggested that controlling the quality, dose and fidelity of WM training in the classroom setting is challenging , but there has been a lack of empirical research into the barriers and facilitators of implementing WM interventions in schools.
To address this, we have developed the ‘Recall to Enhance Children’s Attention Language and Learning’ (RECALL) programme. RECALL is a theoretically underpinned, evidence-based intervention that targets WM, attention and language skills in 4–5-year-old children through group and whole-class activities over a 6-week period. It is designed to be delivered by teachers and teams of health professionals that are commissioned to reduce barriers to learning in one region of the United Kingdom (UK), Northern Ireland . The Regional Integrated Support for Education (RISE) teams include speech and language therapists (SLTs), occupational therapists (OTs), physiotherapists (PTs) and social, emotional and behavioural specialists (SEBs). They support children aged between 3 and 8 years (nursery to year 4) in mainstream schools. The majority of children referred to the team are year one pupils (4–5 year olds), attending schools in areas of low socio-economic status (LSES). There is evidence that for all of the referred children, teachers have identified concerns around their attention and language skills . The RISE teams have developed a whole-class programme, known as the Attention and Listening Programme (ALP), that they currently provide to schools on request. This programme is similar to RECALL in its structure and format but it is not underpinned by WM theory and has not been robustly evaluated.
This protocol describes the rationale, methods and analysis plan for a proposed cluster randomised feasibility trial that will compare RECALL to the existing ALP intervention and education as usual. It aims to resolve uncertainties about the acceptability of RECALL to those who would be delivering it (health professionals and teachers), assess the feasibility of conducting a definitive cluster randomised trial (CRT) of its effectiveness and make a novel contribution to the WM literature regarding the barriers and facilitators to the implementation of WM training in real-life contexts.
Study aim and objectives
The key research question is whether it is possible to design a definitive CRT that will evaluate whether RECALL is more effective than an existing intervention (ALP), and education as usual, for enhancing WM, attention and language skills in 4–5 year olds from LSES areas.
We will conduct a cluster randomised feasibility trial that will enable us to:
Examine the acceptability of the novel RECALL programme and its accompanying manual to the health professionals and teachers who deliver it.
Measure the implementation of RECALL by health professionals and teachers including compliance and fidelity of delivery.
Understand the trial processes at the cluster and individual levels including recruitment, consent and sampling procedures, attendance levels and loss to follow-up.
Determine the acceptability of randomisation to schools.
Explore the appropriateness of the existing intervention (ALP) as an active control comparator to the experimental RECALL programme.
Explore how WM, attention and language skills are typically supported in the classroom (education as usual).
Determine the appropriateness and acceptability of the outcome measures for the children, teachers and health professionals.
Identify the facilitators and barriers (at the cluster and individual levels) to the implementation of RECALL and refine the intervention’s logic model.Footnote 1
This study is a three-arm, cluster randomised feasibility trial with a parallel group design. The novel RECALL classroom programme will be compared to an existing intervention (ALP, the active control) and education as usual (the no intervention control). The delivery of the interventions at the classroom level necessitates the use of a cluster design for this study [34, 35] with each school constituting a cluster. The experimental RECALL programme and the active control intervention will be delivered by health professionals from the multi-disciplinary RISE teams once per week. Thus, they will demonstrate the programmes for the teachers who will then provide two further practice sessions during the week.
Children’s outcomes will be measured at two time points (baseline and 1-week post-intervention). The protocol has been developed according to the SPIRIT 2013 Statement  recommendations for protocol items for clinical trials and the CONSORT 2010 extension to cluster randomised pilot and feasibility trials . Throughout the trial, a process evaluation will explore the factors that could impact on the internal and external validity of a future CRT and the intervention’s logic model for RECALL will be refined [38, 39]. Figure 1 shows the flow chart of the study and Fig. 2 illustrates the timing of all trial processes.
This is a multi-site trial that will be conducted in primary schools in one region of the UK, Northern Ireland (NI), where children commence formal education at 4 years of age. The mainstream school population in NI includes a wide range of children including those with undiagnosed and diagnosed learning or developmental difficulties. Year one classes typically have one teacher, supported by a classroom assistant (CA). The multidisciplinary RISE teams are based within each of the five Health and Social Care Trusts (HSCT) in NI and this study will take place in two of the HSCT areas. The RISE teams work in partnership with schools and provide a range of services including: specialist assessment and intervention for referred children with recognised developmental difficulties; and targeted support for vulnerable children (considered to be at risk of developmental difficulties). Targeted interventions include whole-class and group programmes focusing on particular skills such as attention and listening. The aim of these interventions is to support all children in accessing the curriculum and reduce underachievement .
Sample size and participants
As this is a feasibility study, and the purpose is to explore the acceptability of the intervention rather than its effectiveness, a formal a priori power calculation has not been conducted . The results will not be used to estimate the sample size, intra-cluster correlation or treatment effects for a definitive trial because, in the case of cluster randomised feasibility trials, these can be unrealistic and misleading [42, 43]. Therefore, the number of clusters and individual participants to be recruited has been selected in order to assess the acceptability and feasibility of RECALL and the outcome measures for children’s WM, attention and language skills.
At the cluster level, six schools in areas of LSES will be recruited in total. One class of children in year one (n = ~ 30) will participate in each school (total: n = ~ 180 children). Two classes will receive the RECALL programme, two will receive the active control intervention (ALP) and two will receive education as usual. In the schools allocated to the to RISE and ALP groups, all of the children in the participating classes will receive the interventions. Health professionals from the RISE teams (SLTs, OTs, PTs and SEBs) will be recruited to deliver the RECALL and active control interventions.
Stratification of children
At the individual level, ten children, their parents/guardians and teachers will be recruited in each class to complete the outcome measures (total sample: n = 60 children). Due to the age of the children involved in this study (4–5 year olds), the number of standardised measures available, particularly of WM and attention, is limited. To determine the appropriateness and acceptability of the outcome measures that have been selected, they will be trialled with children representing the typical range of ability in a year one class. Hence, we will use stratified purposeful sampling . Teachers in each class will identify children in three sub-groups/strata: (1) children about whom they have concerns around listening and communication skills but do not have a diagnosed developmental or learning difficulty (n = 5); (2) children with diagnosed developmental or learning difficulties (n = 2); and (3) typically developing children who do not have any identified listening and communication problems as recognised by the teachers (n = 3 per class). Children considered to be typically developing, within areas of social disadvantage, will be included due to the high incidence of speech, language and communication needs in this population .
To recruit clusters, areas of LSES will be identified using data from the Northern Ireland Multiple Deprivation Measure (NIMDM) 2017 . The NIMDM ranks the super output areas in NI from the most to the least deprived across seven types (or domains) of deprivation. An initial scope of this data indicated that there are approximately 72 primary schools in LSES areas in the two HSCTs where this study will take place. These schools will be ranked according to the Education, Skills and Training domain of the NIMDM and the aim is to recruit schools within the lowest decile for each HSCT area. Two local collaborators will be consulted in order to identify schools that meet the eligibility criteria (Table 1). Schools will be contacted in writing by the researchers, followed up by a phone call and a face-to-face meeting with the principal and year one teachers to discuss the study further. If more than one teacher in a school is interested in participating in the study, one class will be randomly selected.
To recruit children and their parents/guardians for outcome measurement (n = 10 in each school), the teachers will send a user-friendly research information leaflet, participant information sheet (PIS) and consent form home with each child. Parents will return the signed consent form to their child’s teacher. From the list of children for whom consent is obtained, the teacher will choose ten pupils for outcome measurement according to the stratified sampling method. To enhance enrolment and retention in the study, parents who complete the communication skills rating scale at both the pre-and post-intervention time-points will be entered into a prize draw for a £100 supermarket shopping voucher.
To recruit the health professionals to deliver the intervention, the team mangers will identify the professionals who meet the eligibility criteria (Table 1) and disseminate the PIS and consent form. Staff will email the researcher to indicate their interest in the study and a meeting will be arranged to discuss this further and obtain written consent.
Table 1 provides the inclusion and exclusion criteria for each participant group and the rationale for each prerequisite.
At the cluster level, written consent for trial entry will be obtained from the school principals . Individual consent for participation will then be obtained from all other participants . The teachers, parents/guardians and children will be asked to take part without being explicitly told about which intervention they will receive. This means consent is not fully informed but it reduces the risk of selection bias and enhances the internal validity of the study . The acceptability of this and its impact on recruitment will be examined in the process evaluation. Consent from the health professionals and school staff will be obtained during the pre-study meetings with the first author. Regarding children’s participation in the study, parental consent will be obtained. Child assent is deemed to be inappropriate in this study due to the age of the children. Although some 5-year-old children may be able to provide assent , there are considerable challenges in knowing if this is accurate . The amount of autonomy children typically exercise in a given situation is also an important consideration . The RECALL programme will be delivered as part of the educational curriculum and in this context children typically have limited autonomy. Although children will not assent to take part, parents will be asked to inform their children that the study is taking place and will be given a child-friendly leaflet to help them tell their child about the research. If parents do not return the consent form, the child will still receive the RECALL or active control interventions but they will not be part of the research study and no outcome measurement will be carried out with them.
Randomisation and allocation
The six schools will be randomised to each arm of the trial: two will receive RECALL; two will receive the active control intervention (ALP); and two will receive education as usual. This will be conducted by the schools’ names being placed in opaque, sealed envelopes which will be selected by an independent person from within the lead researchers’ institute. This process has been deemed as introducing a low risk of bias in allocation concealment . Randomisation will occur after baseline data collection with the children. As previously indicated, children will be selected for outcome measurement using stratification. The teacher will sort the names of all those whose parents provide written informed consent into the three strata previously specified. If more than the required number in each sub-group consent, the participants will be randomly selected using the same process of placing names in opaque envelopes.
The experimental, theoretically underpinned RECALL programme and the active control interventions both incorporate group and whole-class activities designed to be fun for young children. The programmes are comparable in their structure, format and dosage (intervention frequency and duration). They both consist of six, 40-min sessions that are repeated three times per week for 6 weeks (18 sessions in total). The first session each week will be delivered by the health professionals who will model the activities for the teachers so that they can deliver the two further practice sessions.
Experimental intervention: RECALL
RECALL is a theoretically underpinned, multi-component, manualised intervention that explicitly targets WM skills in 4–5 year olds to enhance attention and language skills. It is underpinned by individual change theory (why the intervention components are expected to benefit WM and produce near- and far-transfer effects) and systems theory (considering the role of the school context in affecting change) [52,53,54,55]. It was co-produced through a series of workshops with one group of teachers, parents and health professionals in an inter-sectoral partnership .
Individual theory of change
The tasks included in RECALL are based on evidence from a recent systematic review . The review found certain tasks designed to either target WM directly (listening recall and odd-one-out) or indirectly (cognitively-demanding physical activity, inhibition, phoneme awareness and fantastical play) produced improvements on WM and some benefits for near-transfer activities [57,58,59,60,61,62,63,64,65,66,67]. The common ingredient across the effective interventions was predominantly the executive-loaded nature of the trained task, i.e. training on a task that taps into attentional and processing resources under executive control and not just the storage of information . It has been suggested that repeated practice on executive-loaded working memory (ELWM) tasks (rather than practising storage-only, short-term memory tasks) may improve the efficiency of processing or perhaps even facilitate the storage of information in WM [58, 68]. Based on this evidence, all of the components in RECALL are executive-loaded tasks, where attention must be divided between the storage and processing demands of the task. This may overlap with the way attention is used in everyday (real-world) activities. Hence, since treatment effects are more likely to transfer from trained activities to activities with overlapping features , the direct training on ELWM tasks in RECALL may benefit untrained WM tasks and real-world skills including attention and language.
In addition to directly training ELWM skills, RECALL includes two other tasks that were identified in the systematic review as having potential. Interventions targeting phoneme awareness skills [64, 65] and fantastical play  were found to impact WM indirectly. These are included in RECALL due to their associations with functional language outcomes and attention. They are complementary to and consistent with the theory that ELWM tasks support WM because they are also executive-loaded tasks, i.e. they tap into processing and attentional resources under executive control. Phoneme awareness is the ability to isolate and manipulate sounds in spoken words . Improving phoneme awareness might enhance the phonological mechanisms underlying WM, through increasing the efficiency of processing and supporting the creation of accurate, structured phonological representations. This may in turn support language development since our ability to recall words depends on their phonological representations in long-term memory [70, 71].
Fantastical play is a type of pretend play that is fantasy-oriented . For example, pretend play could involve pretending to make tea, whereas fantastical play might involve pretending to make swamp tea for a giant. Engaging in fantastical play may support children’s WM and other executive functions which are used to support switching between fantasy and reality and remembering the rules/scripts of the pretence [72, 73].
Systems theory of change (intervention delivery model)
The theory underpinning how the ELWM tasks in RECALL can be delivered in the classroom was developed through the co-production workshops. The socio-ecological model  was used as a framework to inform the development of an intervention logic model (i.e. a pictorial representation of the relationships between the required resources, activities needed, mechanisms of change and desired outcomes ). This supported the identification of multi-level factors that may impact on the programme delivery in the classroom, e.g. the timing of intervention sessions in the classroom, the availability of resources and staff training needs. Consequently, the theory underpinning the delivery of RECALL is that the co-designed tasks will work in the classroom context when staff are supported with adequate training and a detailed manual. The health professionals model one RECALL session per week in the classroom. The teachers follow the activity plan in the RECALL manual so that they become familiar with the tasks and can deliver them independently a further two times in the week. Detailed session plans and accompanying materials such as picture stimuli and worksheets are provided in the RECALL manual.
The ELWM tasks incorporated into RECALL include direct training on two ELWM tasks (listening recall and odd one out ), phoneme awareness training [64, 65] and fantastical play . Table 2 provides a description of each task.
The manipulation of WM loads on a trial-by-trial basis may be important for improving WM where research has particularly shown the value of adaptive training, i.e. task difficulty that increases or decreases automatically based on an individual child’s performance . As RECALL is to be delivered in the group context, individual adaptive profiles cannot be rolled out. Instead, the programme is designed to become progressively more difficult across its 6 weeks. Table 2 shows how the direct ELWM and phoneme awareness tasks in RECALL progress in difficulty across the course of the 6-week programme. Due to two novel features of the RECALL trial (the age of the children and the group nature of the intervention), establishing the span level at which to commence training and how to increase the level of difficulty from week to week was reasoned from previous studies with older children . The appropriateness of this for 4–5 year olds will be explored in this feasibility trial.
The amount and intensity of training is often poorly reported in WM studies .Footnote 2 The dosage to be implemented in RECALL is based on the best available evidence from the systematic review which indicated that 11 trials (practice items) of each direct ELWM task (listening recall and odd one out) delivered three times per week for 6 weeks was effective . For the phoneme awareness tasks, the dose (number of trials) administered in previous interventions is unclear. However, several studies identified that training sessions lasted 10–15 min [64, 65] and this is replicated in RECALL.
Structure of RECALL sessions
Each of the six RECALL sessions follows the same format, incorporating whole-class and group activities (Fig. 3). The fantastical theme for the week is introduced using a puppet who tells the children they are going on an adventure. The children are encouraged to enter into the fantasy by moving like characters in the fantastical land, e.g. posing like a superhero. The children are then divided into three groups that rotate around the direct ELWM and phoneme awareness training activities. The sessions close with another whole-class activity so the puppet takes them back to the reality of the classroom.
Active control group: existing ALP
The active control group in this study will receive an existing intervention (ALP) developed and used by the RISE teams. This has been selected as the active control condition because the programme is delivered in the same way as RECALL, i.e. the health professionals model the activities for the teachers and provide them with session plans so that they can replicate them. The programme also has the same dosage as RECALL (six, 40-min sessions that are repeated three times per week delivered once by the health professionals and twice the teachers). This recognises the importance of equating the training intensity between groups in WM research [24, 79].
The crucial difference between this programme and the experimental RECALL intervention is that the ALP intervention is not underpinned by WM theory. It aims to improve children’s attention and listening skills through repeated practice at listening tasks (e.g. the facilitator reads a story and the children must shake a musical instrument when they hear a particular word). It focuses on teaching children the importance of listening and on the use of visual, verbal and behavioural strategies to support listening, e.g. proximal praise. The tasks do not require the children to recall verbal or visuospatial information and they are not all executive-loaded. Whether this intervention is sufficiently different to act as a comparator in a full CRT will be explored in this trial.
No intervention control: education as usual
The two schools in this arm of the trial will not receive any whole-class interventions such as RECALL and the active control intervention during the 6-week trial period. Their teachers will be delivering the education curriculum as usual. How the teachers in these classes support the children’s attention and language skills during the study period will be explored in semi-structured interviews at the end of the trial.
Compliance and fidelity
To enhance the implementation of RECALL, the health professionals, who will be modelling the programme each week for the teachers, will attend a 2-day training course prior to delivering it. They will be given the detailed programme manual which they will also supply to the teachers. To monitor compliance with the programme delivery and dosage, the health professionals and teachers will be asked to keep a simple log of their implementation (e.g. how often they delivered the programme and how long for). To monitor fidelity, three RECALL sessions in each school (one delivered by the health professional team and two by the teacher) will be observed by the first author. One of the health professional sessions and one of the teacher-delivered sessions will be observed simultaneously by a second member of the research team who will independently rate the delivery. Agreement between the raters will be checked by a third member of the team.
The researchers will use a structured observation tool designed within Carroll et al.’s (2007)  conceptual framework to explore four key elements of implementation (content, coverage, frequency, duration) and four moderating variables (intervention complexity, facilitation strategies, quality of delivery and participant responsiveness). Since this is a feasibility study, some adaptation to the intervention will be allowed (i.e. the researchers may address any problems raised by the health professionals or teachers). Any advice given will be recorded and examined in the process evaluation . The interventions will be discontinued if a teacher withdraws from the study. If a health professional withdraws, another member of staff will be recruited and trained.
The school participants (principal, teachers and classroom assistants) and parents/guardians in the two intervention groups will be blinded to their group allocation. It is especially important that teachers and parents are blinded to group allocation, as their ratings of children’s attention skills will be used as outcome measures . Maintaining the teachers’ blinding for the duration of the trial may be challenging, especially if the participating schools are in close geographical proximity to each other. This will be explored as part of the process evaluation in this study. Blinding of the health professionals to the schools’ allocation will not be possible as the teams will inevitably know which intervention they are delivering. The risk of this influencing the outcomes will be minimised further by the blinding of the research assistant (RA) who will be collecting the outcomes data. Whether the RA becomes aware of group allocation will also be investigated during the process evaluation.
Table 3 details the data that will be gathered at the cluster and individual levels to meet the primary objectives of this study regarding the acceptability of RECALL in the school setting and the feasibility of the trial processes.
The acceptability and feasibility data will be gathered throughout the study and during the process evaluation (see Fig. 1). In WM research, it is essential to demonstrate clear causal pathways . A future large-scale trial of the effectiveness of RECALL would therefore have to include a range of measures of children’s outcomes including measures of the trained activities (WM and phoneme awareness skills), untrained WM tasks (near-transfer) and attention and language skills (far-transfer effects). Testing the feasibility and acceptability of measuring all of these skills with 4–5 year olds, for whom the range of standardised assessments is limited, is one of the key objectives of this feasibility trial. This will occur at two points, baseline and post-intervention (see Fig. 2). Four types of measurement will be trialled with the sample of ten children in each cluster.
Standardised assessments administered directly with the children by a trained research assistant (RA).
The RA, who will be blinded to group allocation, will withdraw children individually from their classroom for approximately one hour at each time point to complete the following standardised assessments:
Phoneme awareness: The Preschool and Primary Inventory of Phonological Awareness (PIPA) . This test is standardised for children aged 3 years to 6 years 11 months. It includes six subtests examining a range of phonological awareness skills. The phoneme isolation subtest will be used to directly assess children’s ability to identify the initial sound in a word, thereby providing a measure of a task directly trained in RECALL.
Working memory: The Automated Working Memory Assessment (AWMA)  is a computerised assessment that will be administered using a laptop. This test has good validity as a measure of WM compared to other assessments . Good test-retest reliability has also been demonstrated  and this measure is used widely in WM research. Two subtests will measure trained executive-loaded WM skills (listening recall and odd one out). Four further subtests will measure WM tasks not directly trained in the intervention (near-transfer effects). These subtests (digit recall, block recall, counting recall and non-word recall) have been selected due to their use in previous studies [58, 85].
Attention: NEPSY-II–A Developmental Neuropsychological Assessment (NEPSY) . Standardised, performance-based measures of attention for children under 6 years are limited . The NEPSY-II is one of the few available assessments that includes attention subtests suitable for children of 4–5 years and (or its previous edition) has been administered in relevant studies .
Language: The New Reynell Developmental Language Scales (NRDLS)  is a standardised assessment for children aged between 3 years and 7 years 6 months. It has two scales: one that examines children’s understanding of selected vocabulary items and grammatical features (the Comprehension Scale); and another that tests children’s production of the same features of language (the Production Scale). This test is widely used in clinical and research contexts  in the identification of language impairment. It uses objects (rather than picture stimuli) during the assessment and this should make it accessible to the target population in this study.
A teacher rating scale of the child’s attention in the classroom: The Behaviour Rating Scale of Executive Function-Preschool Version (BRIEF-P) . This tool is designed to specifically measure the behavioural characteristics associated with executive function skills including WM. It is a standardised, validated scale consisting of 63 items that can be used with children from 2 years to 5 years 11 months. It has good clinical utility and sensitivity and has been shown to complement performance-based measures of executive functions including WM [91, 92].
A parent rating scale of the child’s language and communication skills at home. The Focus on Communication Outcomes Under Six (FOCUS) . This has shown excellent test-retest reliability and internal consistency . The forms will be posted to the parents one week before each data collection point and they will be asked to return the form to their child’s teacher. The completed forms will be collected by the RA along with the teacher-completed BRIEF-P.
Weekly monitoring of the child’s performance on the trained tasks. Capturing individual responses will be an important part of a large-scale CRT due to the need for WM training to be adaptive. Therefore, assessing the feasibility of measuring children’s progress from week to week is an important part of the current feasibility study. For the classes receiving RECALL, the children’s performance on the direct WM and phoneme awareness tasks will take place during the first session each week which is delivered by the RISE NI teams. It is anticipated that the presence of additional adults in the classroom will facilitate this process. Each child will have a RECALL booklet in which they will complete the tasks using stampers or by drawing circles around the target pictures to indicate their responses. This will not be possible for some tasks that require purely verbal responses. For these tasks, digital voice recorders will be used (with parental consent) to record what the children say. There are significant uncertainties around the feasibility of audio-recording such data amidst the background classroom noise. Due to the level of uncertainty around this method, we aim to carry this out with just five, randomly selected children, in one of the RECALL classes. The voice recorder will be placed in a small gadget-holder which the children will wear across their bodies. A tie-clip microphone, connected to the recorder, will be placed on the children’s jumpers or lapels. The devices will be switched on and off by the teacher or classroom assistant.
The feasibility data will be analysed and reported descriptively using means, frequencies and percentages. The data will be summarised and presented graphically. A CONSORT flow diagram will be used to report the response, recruitment and retention rate of clusters and individual participants at each point of the study. Where available, reasons for attrition and loss to follow-up will be reported.
Regarding the data obtained from the outcome measures completed with the children, statistical significance of treatment effects will not be analysed as this study would be under-powered for this purpose. However, between group comparisons will be conducted to inform the statistical model for the future trial. This will include two elements: (1) a series of one-way analyses (ANOVAs) of the baseline data of children’s standardised scores on the working memory (AWMA), attention (NEPSY subtests) and language measures (CELF-P) to investigate pre-intervention group differences; and (2) a series of analyses of covariance (ANCOVAs) to investigate post-intervention group differences). As the standardised assessments of WM, language and attention will be repeated within a short time-frame, results from the education as usual group will be used to examine test-retest effects. Qualitative analysis of the data gathered in the semi-structured interviews will be carried out using Braun and Clarke’s (2006) thematic analysis .
A process evaluation will be conducted throughout the study to support an understanding of how the trial processes relate to the context within which RECALL will be implemented . The cluster and individual level data on the acceptability and feasibility of RECALL will be integrated with the qualitative findings and observations of cluster characteristics using the model proposed by Grant et al. . Through this, the barriers and facilitators to implementation will be explored and the intervention logic model developed during the co-production phase will be refined.
Criteria for proceeding to a full CRT
The primary factor for consideration as to whether to proceed to a full trial will be the feasibility data pertaining to recruitment and retention rates and the completion of outcome measures. However, strict thresholds for progression have not been set as these factors can be influenced by contextual variations that may not impact on a future trial [42, 97]. Rather, the decision to proceed to a main trial will be made along by the research team in collaboration with the Trial Steering Committee. Solutions to any problems observed in the feasibility trial will be sought through four potential options suggested by Bugge et al. : (1) adapt the intervention, (2) adjust the context within which the intervention would be delivered, (3) amend elements of the trial design or (4) implement a combination of all of these actions.
Trial steering committee
The conduct of this trial will be overseen by a Trial Steering Committee (TSC) that includes experienced researchers, key stakeholders from the health and education sectors in NI and service users. This group has been involved in the design of the trial and will meet at an interim point to review the progress towards the trial aims and to monitor the safety and well-being of all participants. Due to the nature and purpose of the primary data to be collected in this study (feasibility and acceptability measures), a Data Management Committee is not deemed necessary at this stage but will be established prior to the definitive CRT.
Any modifications to the study protocol such as the eligibility criteria, recruitment procedures or outcome measures will only be carried out in agreement with the TSC. The changes made and reasons underlying them will be carefully recorded as these could be vital to the design of the future trial.
Any adverse events occurring in the course of the trial will be carefully recorded and reported to the TSC, although this is not anticipated given the low risk nature of the study. The TSC will be contacted in this unlikely event and the trial may be discontinued. The study may also be discontinued if both schools in the RECALL arm of the trial withdraw. In the case of the trial being discontinued, all of the other active participants will be informed. The active control intervention may be continued as part of routine practice by the health professionals but no further data would be collected from the children for outcome measurement. The parents would be informed accordingly.
As noted, this is a low-risk study in that no additional potential harm is associated with the research compared to the everyday activity of the participants. The main ethical considerations relate to the welfare of children, parental consent and the children’s capacity to assent, and the maintenance of confidentiality. The schools’ policies regarding health and safety and child protection will be obtained in advance by the research team and adhered to throughout the trial. All members of the research team will hold valid Access NI Enhanced Disclosure CertificatesFootnote 3 confirming they are permitted to work with children in compliance with NI legislation. Through the whole-class sessions, it is possible that children with neurodevelopmental difficulties may be identified by the health professionals. In this instance they will advise the teacher of an appropriate service to which the child could be referred and ask them to seek parental consent prior to making a referral. Children who already attend another service will continue to receive this support during the trial. The procedures for obtaining parental consent in this study have been designed according to guidance provided by the Health Research Authority (2017)  (see consent section). All information/data obtained during the study will remain confidential and will be held in accordance with the General Data Protection Regulation (EU) 2016/679. Aside from the initial consent forms, all further material will be identified by unique number only, with no identifying information. The procedures used to ensure anonymity and confidentiality may be subject to audit through Ulster University’s annual audit programme.
The findings from this trial will be disseminated to all of the participants at a local level through informal networks in the first instance. At a national and international level, the results will be disseminated through conferences and publications in professional literature and peer-reviewed journals prior to the final design and conduct of a full CRT.
To our knowledge, RECALL is the first theoretically underpinned, multi-component, whole-class intervention that specifically aims to enhance WM, attention and language skills in 4–5-year-old children through activities applied within their everyday context. This study responds to calls for ecologically valid approaches to WM intervention for young children [28, 99] and the testing of creative approaches for children with low-language ability who are at risk of academic underachievement and poor employment prospects [8, 9].
A realist perspective underpins all stages of this research, influencing the intervention development, trial design and process evaluation. This approach recognises the impact of context on the implementation of interventions in real-life settings [39, 52, 53], which has been lacking in WM research to date. Therefore, the findings from this feasibility study will be of interest to researchers and practitioners interested in implementing WM interventions in the classroom.
In particular, the observations of RECALL being delivered in the classroom will allow investigation of whether it is possible for WM interventions to be delivered in the classroom with fidelity to their design and dosage. Key in this examination will be whether the executive-loaded nature of the trained tasks is maintained in their implementation. The inclusion of qualitative data in the process evaluation is a strength of this feasibility trial. This will allow us to explore participants’ views on the acceptability of RECALL and, crucially, the reasons for any differences between the intervention model and their fidelity to it. Thus we will be able to identify issues that may impact on the external and internal validity of a large-scale CRT.
The study design takes cognisance of the previous criticisms of the methodological quality of previous WM research [23,24,25], through the inclusion of an active control group (receiving a comparable intervention in terms of structure and dosage) and the blinding of outcomes assessors. The findings from this feasibility study will inform whether it can be scaled-up into a full CRT to evaluate the clinical and cost-effectiveness of RECALL.
Recruitment will commence in December 2018.
See Kellogg Foundation 2004 guidance for a comprehensive overview of logic modelling .
The term dosage is used to refer to all components of the intervention intensity; dose refers to the number of trials per single intervention session .
AccessNI Criminal Record checks are compulsory for all employees or volunteers in working with vulnerable adults or children in NI (https://www.nidirect.gov.uk/articles/types-accessni-checks)
Attention and Listening programme
Cluster randomised trial
Health and Social Care Trust
Low socio-economic status
Recall to Enhance Children’s Attention Language and Learning
Regional Integrated Support for Education
Social Emotional and Behaviour Specialist
Speech and language therapist
Trial Steering Committee
World Health Organization (WHO) Social Determinants of Mental Health. 2014. https://apps.who.int/iris/bitstream/10665/112828/1/9789241506809_eng.pdf. Accessed 9 Sept 2015.
Conti-Ramsden G, Durkin K, Mok PLH, Toseeb U, Botting N. Health, employment and relationships: correlates of personal wellbeing in young adults with and without a history of childhood language impairment. Soc Sci Med. 2016;160:20–8.
Elliott NL. An investigation into the communication skills of long-term unemployed young men. 2011. http://ethos.bl.uk/OrderDetails.do?uin=uk.bl.ethos.553779 Accessed 30 Sept 2017.
Roulstone S, Law J, Rush R, Clegg J, Peters T. Investigating the role of language in children’s early educational outcomes. Bristol: University of the West of England; 2011.
Archibald LM. SLP-educator classroom collaboration: a review to inform reason-based practice. Autism & Developmental Language Impairments. 2017;2:1–17.
Cirrin FM, Schooling TL, Nelson NW, Diehl SF, Flynn PF, Staskowski M, et al. Evidence-based systematic review: effects of different service delivery models on communication outcomes for elementary school–age children. Lang Speech Hear Serv Sch. 2010;41:233–64.
Ebbels SH, McCartney E, Slonims V, Dockrell J, Norbury CF. Evidence based pathways to intervention for children with Language Disorders. Int J Lang Commun Disord. 2019;54(1):3–19.
Nippold MA. Different service delivery models for different communication disorders. Lang Speech Hear Serv Sch. 2012;43(2):117–20.
Norbury CF, Vamvakas G, Gooch D, Baird G, Charman T, Simonoff E, et al. Language growth in children with heterogeneous language disorders: a population study. J Child Psychol Psychiatry. 2017;58(10):1092–105.
Botting N. The interplay between language and cognition. In: Clegg J, Ginsborg J, editors. Language and Social Disadvantage, vol. 2006. Chichester: Wiley; 2006. p. 28–43.
Kapa LL, Plante E. Executive function in SLI: recent advances and future directions. Curr Dev Disord Rep. 2015;2(3):245–52.
Allen RJ, Hitch GJ, Baddeley AD. Cross-modal binding and working memory. Vis Cogn. 2009;17(1–2):83–102.
Baddeley AD, Hitch GJ. Working Memory. In: Bower GH, editor. The psychology of learning and motivation, vol. 8. London: Academic Press; 1974.
Cowan N. (2008). What are the differences between long-term, short-term, and working memory? Prog Brain Res. 2008;169:323–38.
Alloway TP, Gathercole SE, Kirkwood H, Elliott J. The cognitive and behavioural characteristics of children with low working memory. Child Development. 2009;80(2):606–21.
Bunting MF, Cowan N. Working memory and flexibility in awareness and attention. Psychological Research. 2005;69:412–9.
Cowan N, Fristoe NM, Elliott EM, Brunner RP, Saults JS. Scope of attention, control of attention and intelligence in children and adults. Mem Cogn. 2006;34(8):1754–68.
Baddeley AD, Gathercole SE, Papagno C. The phonological loop as a language learning device. Psychol Rev. 1998;105:158–73.
Archibald LM. Working memory and language learning: a review. Child Lang Teach Ther. 2017;33(1):5–17.
Holmes J, Butterfield S, Cormack F, Loenhoud AV, Ruggero L, Kashikar L, et al. Improving working memory in children with low language abilities. Front Psychol. 2015;6:519.
Cogmed Working Memory Training. Pearson Assessment; 2005.
Soveri A, Antfolk J, Karlsson L, Salo B, Laine M. Working memory training revisited: a multi-level meta-analysis of n-back training studies. Psychon Bull Rev. 2017;24:1077–96.
Melby-Lervåg M, Hulme C. Is working memory training effective? A meta-analytic review. Dev Psychol. 2013;49(2):270–91.
Melby-Lervåg M, Redick TS, Hulme C. Working memory Training does not improve performance on measures of intelligence or other measures of “far transfer”: evidence from a meta-analytic review. Perspect Psychol Sci. 2016;11(4):512–34.
Redick TS, Shipstead Z, Wiemers EA, Melby-Lervåg M, Hulme C. What’s working in working memory training? An educational perspective. Educ Psychol Rev. 2015;27:617–33.
Gathercole SE, Holmes J, Dunning DL, Norris D. Working memory training involves learning new skills. J Mem Lang. 2019;105:19–42.
Dunning D, Holmes J, Gathercole SE. Does working memory training lead to generalized improvements in children with low working memory? A randomized controlled trial. Dev Sci. 2013:1–12.
Dunning D, Holmes J. Does working memory training promote the use of strategies on untrained working memory tasks? Mem Cogni. 2014;2:854–62.
Jaeggi SM, Buschkuehl M. Working memory training and transfer: theoretical and practical considerations. In: Toni B, editor. New Frontiers of Multidisciplinary Research in STEAM-H (Science, Technology, Engineering, Agriculture, Mathematics, and Health). Springer Proceedings in Mathematics & Health, vol 90. Cham: Springer; 2014;16(6):915–925
Schwaighofer M, Fischer F, Bühner M. Does working memory training transfer? A meta-analysis including training conditions as moderators. Educ Psychol. 2015;50(2):138–66.
Department of Education (DENI) Budget 2006–08 Children and Young People Funding Package. Belfast: Department of Education; 2006.
Harron A, Dickson F. Perspectives on trans-disciplinary working for children in mainstream education. Oral presentation: rehabilitation and Therapy Research Society conference; 2013.
Kellogg Foundation WK. Logic Model Development Guide. Battle Creek, MI: W.K Kellogg Foundation; 2004.
Medical Research Council (MRC) Cluster randomised trials. Methodological and ethical considerations. London: Medical Research Council; 2002.
Edwards SJL, Braunholtz DA, Lilford RJ, Stevens AJ. Ethical issues in the design and conduct of cluster randomised controlled trials. BMJ. 1999;318(7195):1407–9.
Chan A-W, Tetzlaff JM, Altman DG, Laupacis A, Gøtzsche PC, Krleža-Jerić K, et al. SPIRIT 2013 statement: defining standard protocol items for clinical trials. Ann Intern Med. 2013;158:200–7.
Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. BMJ. 2016;355:i5239.
Craig P, Dieppe P, McnItyre S, Mitchie S, Nazareth I, Petticrew M. Developing and evaluating complex interventions: the new Medical Research Council guidance. BMJ. 2008;337:a1655.
Moore G, Evans R. What theory, for whom and in which context? Reflections on the application of theory in the development and evaluation of complex population health interventions. SSM Population Health. 2017;3:132–5.
Gascoigne M. Supporting children with speech, language and communication needs within integrated children’s services. RCSLT Position Paper. London: RCSLT; 2006.
Arain M, Campbell MJ, Cooper CL, Lancaster GA. What is a pilot or feasibility study? A review of current practice and editorial policy. BMC Med Res Methodol. 2010;10:67.
Eldridge SM, Costelloe CE, Kahan BC, Lancaster GA, Kerry SM. How big should the pilot study for my cluster randomised trial be? Stat Methods Med Res. 2015;25(3):1039–56.
Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10(1):1–10.
Sandelowski M. Combining qualitative and quantitative sampling, data collection and analysis techniques in mixed-methods studies. J Nurs Health Res. 2000;23:246–55.
Northern Ireland Multiple Deprivation Measure (NIMDM) (2017) https://www.nisra.gov.uk/statistics/deprivation/northern-ireland-multiple-deprivation-measure-2017-nimdm2017. Accessed 28 Mar 2018.
Mohr DC, Spring B, Freedland KE, Beckner V, Arean P, Hollon SD, et al. The selection and design of control conditions for randomized controlled trials of psychological interventions. Psychother Psychosom. 2009;78:275–84.
Eldridge SM, Ashby D, Feder GS. Informed patient consent to participation in cluster randomized trials: an empirical exploration of trials in primary care. Clin Trials. 2005;2:91–8.
Meaux JB, Bell PL. Balancing recruitment and protection: children as research subjects. Issues Compr Pediatr Nurs. 2001;24(4):241–51.
Fargas Malet M, McSherry D, Larkin E, Robinson C. Research with children: methodological issues and innovative techniques. J Early Child Res. 2010;8(2):175–92.
Health Research Authority (HRA) Consent and Participant Information Sheet Preparation Guidance V4 February 2017. http://www.hra-decisiontools.org.uk/consent/index.html. Accessed 15 Dec 2017.
Higgins JPT, Altman DG. Assessing risk of bias in included studies. In: J.P.T, Higgins JPT, Green S, editors. Cochrane Handbook for Systematic Reviews of Interventions. Chichester: Wiley; 2008.
Shearn K, Allmark P, Piercy H, Hirst J. Building realist program theory for large complex and messy interventions. Int J Qual Methods. 2017;16:1–11.
Shiell A, Hawe P, Gold L. complex interventions or complex systems? Implications for health economic evaluation. BMJ. 2008;336:1281–3.
Wright D, Wimbush E, Jepson R, Doi L. Six steps in quality intervention development (6SQuID). J Epidemiol Community Health. 2016;70:520–5.
Stokols D. Toward a science of transdisciplinary action research. Annu J Commun Psychol. 2006;38(6):63–77.
Rowe A, Titterington J, Holmes J, Henry L, Taggart L. A systematic review of the effectiveness of non-computerized interventions targeting working memory in 4–11 year olds. Dev Rev. 2019;52:1–23.
Cornoldi C, Carretti B, Drusi S, Tencati C. Improving problem solving in primary school students: the effect of a training program focusing on meta-cognition and working memory. Br J Educ Psychol. 2015;85:424–39.
Henry LA, Messer DJ, Nash G. Testing for near and far transfer effects with a short, face-to-face adaptive working memory training intervention in typical children. Infant Child Dev. 2014;23(1):84–103.
Passolunghi MC, Costa HM. Working memory and early numeracy training in preschool children. Child Neuropsychol. 2016;22(1):81–98.
Witt M. School based working memory training: preliminary finding of improvement in children’s mathematical performance. Adv Cogn Psychol. 2011;7(1):7–15.
Alesi M, Bianco GL, Palma A, Pepi A. Improving children’s coordinative skills and executive functions: the effects of a football exercise program. Percept Mot Skills. 2016;122(1):27–46.
Kamijo K, Pontifex MB, O’Leary KC, Scudder MR, Wu C, Castelli DM, et al. The effects of an afterschool physical activity program on working memory in preadolescent children. Dev Sci. 2011;14(5):1046–58.
Koutsandréou F, Wegner M, Niemann C, Budde H. Effects of motor versus cardiovascular exercise training on children’s working memory. Med Sci Sports Exerc. 2016;48(6):1144–52.
Melby-Lervåg M, Hulme C. Serial and free recall in children can be improved by training: evidence for the importance of phonological and semantic representations in immediate memory. Psychol Sci. 2010;21(11):1694–700.
Van Kleeck A, Gillam RB, Hoffman LM. Training in phonological awareness generalizes to phonological working memory: a preliminary investigation. J Speech Lang Pathol – Applied Behavior Analysis. 2006;1(3):228–43.
Thibodeau RB, Gilpin AT, Brown MM, Meyer BA. The effects of fantastical pretend-play on the development of executive functions: An intervention study. J Exp Child Psychol. 2016;145:120–38.
Volckaert AMS, Noël M. Training executive function in preschoolers reduce externalizing behaviors. Trends Neurosci Educ. 2015;4:37–47.
Loosli SV, Buschkuehl M, Perrig WJ, Jaeggi SM. Working memory training improves reading processes in typically developing children. Child Neuropsychol. 2011;18:62–78.
Hulme C, Bowyer-Crane C, Carroll JM, Duff FJ, Snowling MJ. The causal role of phoneme awareness and letter-sound knowledge in learning to read: combining intervention studies with mediation analyses. Psychol Sci. 2012;23(6):572–7.
Bishop DVM, Snowling MJ. Developmental dyslexia and specific language impairment: same or different? Psychol Bull. 2004;130:858–86.
Pennington BF, Bishop DVM. Relations among speech, language, and reading disorders. Annu Rev Psychol. 2009;60:283–306.
Estes D, Wellman HM, Woolley J. Children’s understanding of mental phenomena. In: Reese H, editor. Advances in child development and behavior. New York: Academic Press; 1989. p. 41–86.
Golumb C, Kuersten R. On the transition from pretense play to reality: what are the rules of the game? Br J Dev Psychol. 1996;14:203–17.
McLeroy KR, Bibeau D, Steckler A, Glanz K. An ecological perspective on health promotion programs. Health Educ Behav. 1988;15:351–77.
Cunningham AE. Explicit versus implicit instruction in phonemic awareness. J Exp Child Psychol. 1990;50:429–44.
Shriberg LD. Four new speech and prosody-voice measures for genetics research and other studies in developmental phonological disorders. J Speech Hear Res. 1993;36:105–40.
Klingberg T. (2010) Training and plasticity of working memory. Trends Cogn Sci. 2010;14(7):317–24.
Warren SF, Fey ME, Yoder PJ. Differential treatment intensity research: a missing link to creating optimally effective communication interventions. Ment Retard Dev Disabil Res Rev. 2007;13:70–7.
Shipstead Z, Hicks KL, Engle RW. Working memory training remains a work in progress. J Appl Res Mem Cogn. 2012;1:217–9.
Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(40):1-9.
Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ. 2012;350:h1258.
Dodd B, Crosbie S, Macintosh B, Teitzel T, Ozanne A. Primary and Preschool Battery of Phonological Awareness (PIPA). London:Psychological Corporation; 2000.
Alloway TP. Automated working memory assessment. London: Pearson Assessment; 2008.
Alloway TP, Gathercole SE, Kirkwood HJ, Elliot JE. Evaluating the validity of the automated working memory assessment. Educ Psychol. 2008;7:725–34.
Elliott JG, Gathercole SE, Alloway TP, Holmes J, Kirkwood H. An evaluation of a classroom-based intervention to help overcome working memory difficulties and improve long-term academic achievement. J Cogn Educ Psychol. 2010;9(3):227–50.
Korkman M, Kirk U, Kemp S. NEPSY-II: a developmental neuropsychological assessment. San Antonio, TX: The Psychological Corporation; 2007.
Mahone EM, Schneider HE. Assessment of attention in pre-schoolers. Neuropsych Rev. 2012;22(4):361–83.
Edwards S, Letts C, Sinka I. The New Reynell Developmental Language Scales. London: GL-Assessment; 2011.
Letts C, Edwards S, Sinka I, Schaefer B, Gibbons W. Socio-economic status and language acquisition: children ‘s performance on the new Reynell Developmental Language Scales. Int J Lang Commun Disord. 2013;48(2):131–43.
Gioia GA, Espy KA, Isquith PK. The Behavior Rating Inventory of Executive Function-Preschool version (BRIEF-P). Odessa, FL: Psychological Assessment Resources; 2003.
Mahone EM, Hoffman J. Behavior Ratings of Executive Function among Preschoolers with ADHD. Clin Neuropsychol. 2007;21:569–86.
Sherman EMS, Brooks BL. Behavior Rating Inventory of Executive Function—Preschool Version (BRIEF-P): test review and clinical guidelines for use. Child Neuropsychol. 2010;16(5):503–19.
Thomas-Stonell NL, Oddson B, Robertson B, Rosenbaum P. Development of the FOCUS (Focus on the Outcomes of Communication Under Six), a communication outcome measure for preschool children. Dev Med Child Neurol. 2010;52:47–53.
Washington K, Oddson B, Robertson B, Rosenbaum P, Thomas-Stonell N. Reliability of the focus on the outcomes of communication under six (FOCUS). J Clinical Pract Speech-Lang Pathol. 2013;15(1):25–31.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
Grant A, Treweek S, Dreischulte T, Foy R, Guthrie B. Process evaluations for cluster-randomised trials of complex interventions: a proposed framework for design and reporting. Trials. 2012;14:15.
Eldridge SM, Lancaster GA, Campbell MJ, Thabane L, Hopewell S, Coleman CL, Bond CM. Defining feasibility and pilot studies in preparation for randomised controlled trials: development of a conceptual framework. PLoS ONE. 2016;11(3):e0150205.
Bugge C, Williams B, Hagen S, Logan J, Glazener C, Pringle S, et al. A process for decision-making after pilot and feasibility trials (ADEPT): development following a feasibility study of a complex intervention for pelvic organ prolapse. Trials. 2013;14:353.
Wass SV, Scerif G, Johnston MH. Training attentional control and working memory- is younger better? Dev Rev. 2012;32:360–87.
The authors thank Dr. Joni Holmes (MRC Cognition & Brain Sciences Unit, University of Cambridge) and Professor Lucy Henry (City, University of London) for their contributions to the theoretical underpinning and design of RECALL; and Professor Mike Clarke (Director of MRC Methodology Hub, Queen’s University Belfast) for his input to the methodological design of this feasibility trial.
This trial constitutes part of a doctoral research study funded by the Research and Development Division of the Public Health Agency, Northern Ireland. The funder has not been involved in the design of the protocol and will have no input to the interpretation or publication of the study results. The authors alone will be responsible for the conduct of the trial, the data analysis, interpretation and publication of the findings.
Availability of data and materials
As this is a feasibility trial, sharing of the dataset is not anticipated. However, any requests for data or material should be made to the corresponding author. Requests will be reviewed by the Trial Steering Committee.
Ethical approval for this study has been granted by the Ulster University Research Ethics Committee (REC/18/0036). The trial has been registered with the International Standard Randomised Controlled Trial Registry (ISRCTN13633886).
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.