- Study Protocol
- Open Access
- Open Peer Review
Family Empowerment (FAME): study protocol for a pilot implementation and evaluation of a preventive multi-family programme for asylum-seeker families
Pilot and Feasibility Studiesvolume 5, Article number: 62 (2019)
Families applying for asylum have often experienced multiple potentially traumatic events and continue to face stressors during their resettlement. Studies have indicated that traumatic events can negatively impact parenting behaviour and child development. A secondary preventive multi-family intervention programme, called Family Empowerment, was developed. Family Empowerment aims to strengthen parenting skills and prevent exacerbation of emotional problems in asylum-seeker families. This study protocol aims to evaluate the feasibility, acceptability, and potential effectiveness of Family Empowerment to reduce parental mental health problems and improve family functioning.
An uncontrolled pre-test-post-test design will be conducted, using a mixed-methods approach. Approximately 60 families living at asylum centres and family locations with children aged 0–18 will be included. All participants will be invited to take part in seven sessions of Family Empowerment. Measurements take place at baseline, during implementation of Family Empowerment and 1 week post-Family Empowerment. Demographic data, the quality of the parent-child interaction, family functioning, parental symptoms of depression and anxiety, and participants’ feedback on progress and the therapeutic alliance will be assessed. A programme integrity list will be filled out during each session. Semi-structured interviews at baseline and post-Family Empowerment will be used to evaluate Family Empowerment.
This is the first study to provide a pilot implementation and evaluation of Family Empowerment. The current study will inform us on how to improve programme elements and the implementation of Family Empowerment. Limitations are discussed.
Dutch Trial Register, TC = NTR6934. Registered on January 8 2018.
In 2017, approximately half of all refugees worldwide were minors below 18 years of age. Most of these minors arrived in the country of resettlement with at least one parent or caregiver. These refugee families have been forced to flee their homes as a result of persecution, violence, or conflict . Many of them have been exposed to multiple potentially traumatic events prior to and during their flight, such as the loss of loved ones, war-related events, and physical violence. Furthermore, studies indicate that the continuous stressors refugees are exposed to during resettlement, including social and economic insecurities and long and complex asylum procedures, affect their psychological functioning [2, 3]. Table 1 describes the placement procedure of refugees applying for asylum in the Netherlands.
The accumulation of disruptive events and circumstances before and during the flight and the stressors inextricably linked with migration and resettlement can affect the psychological functioning of asylum-seeker families [2, 7]. Although studies indicate that most refugees do not develop mental health disorders, a substantial minority develops adverse emotional reactions and stress-related complaints, such as difficulty concentrating, sleeping problems, and irritability [8, 9]. Such complaints can impact the daily lives of refugee children, including their educational achievements, social functioning, and family interactions [9, 10].
Asylum-seeker children cannot be seen in isolation from the context and environment in which they grow up. Their parents often have to deal with their own distressing experiences, losses, and continuous stressors. As a result, they are at risk of developing stress-related complaints, which can undermine their parenting skills. For example, they can be less emotionally available, less structuring, and less supporting towards their children . Additionally, exposure to traumatic situations can disrupt the parents’ and child’s capacity to mentalize, which refers to the ability to reflect upon and understand the state of mind of yourself and the other [12, 13]. A reduced capacity to mentalize may negatively affect the development of healthy attachment relationships between parents and their children and consequently affect the overall development of the child [12, 13]. However, clinical experience suggests that the detrimental impact of stress-related complaints on parenting skills can be counteracted by focusing on social and psychological support to help families adapt after distressing events [6, 9]. A recent review showed that studies focusing on preventive programmes addressing asylum-seeker families have been scarce so far .
Multi-family therapy (MFT) has been developed by Laqueur et al.  in order to improve family functioning and strengthen social support. MFT has since been adapted to meet the needs of various groups, including patients who suffer from symptoms of anorexia, schizophrenia, depression, and conduct disorder [15, 16]. MFT is a psychosocial intervention for a group of at least two families including at least two family members from different generations . Since its development, MFT has been conducted with a variety of theoretical models, illnesses, disorders, and populations . The frequency, duration, and number of sessions differ across settings and populations. Activities are adapted for each specific setting and population. MFT focuses on issues or concerns that families have in common and that are directly or indirectly related to family interactions. Sessions focus on strengthening interfamilial relations. For over 10 years, MFT has been provided to refugee families at the Foundation Centrum ‘45, a Dutch centre for specialist diagnostics and treatment of people with complex psychotrauma complaints.
At the Foundation Centrum ’45, MFT has, so far, mainly been offered to families with severe mental health problems and impaired family functioning. The main principles underlying MFT can also be applied in a preventive programme. Accordingly, therapists and researchers at the Foundation Centrum ‘45 developed a secondary preventive programme for asylum-seeker families based on MFT: Family Empowerment (FAME). FAME addresses families who live under stressful circumstances in asylum centres and family facilities and who may experience the impact of stress-related complaints on parenting, individual mental health, and family functioning. The programme addresses families with diverse cultural backgrounds. As described in more detail below, during FAME, a varying number of five to eight families gather in one room in weekly sessions of approximately 2–3 h for seven consecutive weeks. The aim is to reinforce parenting skills and social support, to improve family functioning and to prevent further development of emotional problems. FAME focuses on activating the families’ own resources and knowledge and allows families to exchange their perspectives, feedback, support, and knowledge. Skills can be developed and practised in a safe environment. Mentalization plays an important role in FAME, as the programme aims to stimulate reflection on one’s own and others’ thought processes and emotions .
Although FAME has previously been offered at a family facility, the effects of the programme have not yet been evaluated systematically . Weine  proposed a cycle for developing and evaluating preventive programmes for refugee families based on empirical evidence. This cycle encompasses five steps, namely step 0, foundational activities; step 1, template preparation; step 2, situation-specific adaptation; step 3, intervention trial; and step 4, new situations. The development of the FAME manual is in line with both the foundational activities (step 0) and the template preparation (step 1) . The manual describes programme elements that have been developed based on empirical evidence and clinical experience with refugees and MFT . Step 2, situation-specific adaption, was conducted as the programme elements were adapted to fit the needs of asylum-seeker families living in asylum centres and family facilities. The resulting FAME programme adheres to the principles and approaches as described in the manual and incorporates situation-specific adaptations. The aim of the current study is to realize step 3 of the cycle proposed by Weine : performing a pilot intervention trial, to demonstrate programme characteristics such as feasibility (whether the preventive programme is doable), acceptability (whether families and trainers accept the programme), and potential effectiveness (whether the programme coincides with positive changes in key outcomes). This precedes the final step (step 4), namely ‘new situations’, which includes conducting intervention trials at other sites and in other contexts.
The current pilot study aims to evaluate the feasibility, acceptability, and potential effectiveness of FAME to reduce parental mental health problems and improve family functioning. As families living in family locations might suffer from increased levels of distress, we expect these families to have more difficulties concerning the parent-child relationship, parental symptoms, and family functioning than families living in asylum centres. Therefore, baseline distress levels of both categories of families will be compared. Specifically, the objectives are to determine:
Whether it is feasible to offer FAME to families living in Dutch asylum centres and family facilities.
Whether FAME is acceptable to asylum-seeker families.
Whether undergoing FAME coincides with a reduction in parental symptoms of anxiety and depression and improvement in family functioning.
Baseline differences and similarities in the parent-child relationship, parental symptoms of anxiety and depression, and family functioning between families living in asylum centres and families living in family facilities.
An uncontrolled, two-group pre-test-post-test design will be conducted, using a mixed-methods approach. Standardized questionnaires, semi-structured interviews, an observational scale, and a (self-constructed) programme integrity list will be used. The programme, including measurements, will take approximately 10 weeks per group.
Study participants will be recruited from the asylum-seeker family population in the Netherlands. Families will be selected through convenience sampling. Eligible families must meet the following criteria: (1) at least one caregiver participates in FAME, (2) at least one child aged 0–18 participates, and (3) the family lives in an asylum centre or family facility. Participants who are not able to function in a group, as reported by health teams of the family facility or asylum centre, are not eligible for this study. For example, participants who are likely to experience difficulties communicating in a group setting as a result of severe psychiatric illness, such as psychosis, will be excluded. Families with psychiatric problems, such as posttraumatic stress disorder or depression, who are likely to be able to benefit from FAME are included in the study. This will be discussed with the health teams prior to inviting the families to take part in the information session about FAME. Each group will include approximately five to eight families. Families will be divided over the groups based on the age of their child (0–5, 6–12, 13–18). However, this division cannot be followed strictly, for example, because some families have children in more than one age category. Therefore, the division will be used merely as a guideline. If there are multiple children in a family, parents are asked with which child they experience most difficulties and will be allocated to the age group of that child. All children of the family are invited to take part in the programme.
As this is a pilot implementation and evaluation of a programme that has not been studied previously, it was not considered appropriate to conduct a reliable sample size calculation. We aim to include approximately five living locations. In each location, we will recruit two groups of approximately six families. This will result in a total sample size of approximately 60 families (5 × 2 × 6). One or two parents and approximately one to two children of each family will take part, resulting in a total number of approximately 90 parents and 90 children.
FAME is offered to families living in family locations and asylum centres. FAME encompasses seven sessions. Apart from the introduction session and final evaluation session, each session has a similar structure. The sessions start with an energizing activity to warm up the participants and promote positive group interactions. Subsequently, the main activity, representing the central theme of the session, takes place. The themes and activities of FAME are based on the metaphor ‘the bucket and the treasure chest’. The bucket is a metaphor for the number of stressful factors and problems families are exposed to. The bucket is filled with soluble and insoluble problems. The treasure chest represents the sources of support the families have. During the programme, families and trainers will focus on questions such as: ‘What are sources of stress in the bucket, and what are sources of support in the treasure chest?’ The bucket and treasure chest can be found in the manual of FAME . The role of the trainer can be described as an ‘eagle’, as he or she walks around the room and zooms in on important positive or problematic interactions that arise. The family members function as ‘consultants’ for each other, as they can offer and receive feedback and support. The sessions are ended by reflecting on what the families have discussed and learned. A manual on FAME for families with children aged six to twelve has been published in Dutch . The programme was further adapted to fit the other age groups addressed in this study. Trainers who offer FAME are therapists working at Centrum ‘45, who have ample experience in working with refugees and asylum-seekers and in working with FAME. Table 2 lists the sessions, themes, and aims of FAME.
Families in both living conditions follow the same procedure. In cooperation with health teams at family facilities and asylum centres throughout the Netherlands, asylum-seeker families will be invited to take part in an introduction session. Participants will be informed about this initial introduction session through flyers and verbal information offered by local partners and researchers. The aim of the introduction session is to explain certain aspects of the programme, such as the structure, number, and duration of the sessions, and to clarify expectations. Families are given the opportunity to ask any questions they might have. During the week after the introduction session, families that have stated their interest in taking part in the programme will be visited. During this visit, any further questions can be answered. Participants who want to take part in the study are then asked to fill in a written informed consent. Parents fill in an informed consent for their children under the age of 16. Minors over 12 years of age fill in an informed consent as well.
Families who agree to take part in the study are subjected to pre-test measures (t1). One of the researchers will either visit them at home or arrange a quiet room. A professional (telephone) interpreter will be provided. During this visit, parents will be asked to fill out questionnaires (see the ‘Measurements’ section), and a semi-structured interview with the parents will take place. If the participants agree, their semi-structured interviews will be audio-recorded. If the family members agree to take part in videotaping, the parent-child relationship will subsequently be assessed by videotaping the interaction between parent and child for approximately 20 min. Pre-test measures will last approximately 90 min for the parents, and 20 min for the children.
As noted, FAME involves seven weekly 2–3-h sessions. One or two official interpreters will be provided in each group. At the end of each session, the participants are asked to fill in scales measuring their distress and how they rate the session (t2). The scales will be explained by the trainer, who is aided by the interpreters. Moreover, during the sessions, a researcher will evaluate programme integrity using a predetermined programme integrity list (see below). The final assessment (t3) takes place in the week after the last session of FAME. The participants will be visited at home or a private room will be arranged. A (telephone) interpreter will be provided. The parents and children aged five and over will take part in individual semi-structured interviews. Parents will fill in questionnaires. Post-test measures will last approximately 65 min for the parents and 30 min for the children. See Table 3 for the schedule of enrolment, intervention, and assessment.
Family functioning will be measured using the Systemic Clinical Outcome and Routine Evaluation (SCORE-15; ). The SCORE-15 is a 19-item self-report questionnaire that can be used to monitor and report indicators of progress in systemic therapy. It offers an overall measure of family functioning as well as sub-scale scores on the dimensions: strength and adaptability, overwhelmed by difficulties, and disrupted communication. The validity of the SCORE-15 as an index of therapeutic change has been established. The questionnaire demonstrates good test-retest reliability, construct validity, and responsiveness in terms of clinical and reliable change [21, 22].
Parental symptoms of depression and anxiety will be assessed using the 4-item Patient Health Questionnaire for Depression and Anxiety (PHQ-4; ). The PHQ-4 has been validated in the general population. The total score is an index of anxiety and depression severity .
The following demographics of the participating family members will be collected: age, gender, country of origin, time spent in the Netherlands, number and age of family members, and educational level.
Parents and children
Parents and children are subjected to an observational measurement. Quality of the parent-child relationship will be measured using the Emotional Availability Scales (EAS) developed by Biringen et al. . They described emotional availability as ‘the capacity of a dyad to share an emotionally healthy relationship’ (p. 114; ). When conducting the EAS, a parent-child dyad is asked to interact as they would usually do for approximately 20 min. These interactions are videotaped and consequently scored on the EAS by certified objective observers with ample experience in working with refugees. EAS measures four caregiver components: sensitivity, structuring, non-intrusiveness, and non-hostility. The child components measured by the EAS are the child’s responsiveness to the caregiver and the child’s involvement with the caregiver. A score on a Likert scale of 1–7 on each component is used for data analysis. A score of 7 suggests that the participant displays optimal behaviours on that scale, a score of 4 indicates inconsistent behaviour, and a score of 1 indicates that the participant displays non-optimal behaviour. Studies suggest that the EAS is universally applicable, and cross-cultural validity has been established in various countries [26, 27].
To monitor participants’ feedback on progress, a self-report scale will be used: the (Young Child) Outcome Rating Scale ((YC)ORS). The (YC)ORS has four single-item subscales: individual, relational, social, and general. Sample questions of the CORS include ‘How am I doing?’ and ‘How are things in my family?’. To assess therapeutic alliance, the (Young Child) Sessions Rating Scale ((YC)SRS) will be used. The four single-item subscales of the (YC)SRS include relationship, goals and topics, approach and method, and overall. Both the (YC)ORS and the (YC)SRS are visual and analogue. Both scales have demonstrated adequate validity, solid reliability, and high feasibility [28, 29].
To evaluate whether the programme is feasible and can be executed as intended, we developed a programme integrity list. This checklist is based on the four dimensions of programme integrity : (1) Adherence, the specified components of the programme; (2) Exposure, the extent to which family members are exposed to the programme, by monitoring presence and duration (presence is measured by registering the number of minutes each family is present and duration by monitoring the duration of each session in minutes); (3) Quality of delivery, therapeutic skills and competence, measured by scoring items such as ‘zoomed in on problematic interactions’ and ‘allowed participants to practise with learned behaviours’; (4) Participant responsiveness, measured by assessing reactions during the session, including positive interactions (e.g. laughter) and active participation. Additional questions about participant responsiveness will be asked during the semi-structured interview (t3). We aim to observe all FAME sessions offered during this study. All assessors will be trained in using the programme integrity list. Two independent assessors will be present during several sessions to fill in the programme integrity list. Inter-rater reliability will be calculated.
Parents and children
Analysis of quantitative data
Quantitative data-analysis will be conducted using SPSS 23 (IBM Statistics). Descriptive statistics of demographic data, the programme integrity list, and the rating scales will be presented for all participants. For continuous variables, means, standard deviations, medians, and ranges will be reported. For categorical variables, numbers and percentages will be reported.
To test the hypothesis that families living at family facilities have more problems concerning the parent-child relationship and family functioning and higher parental symptoms of anxiety and depression than families living at asylum centres, pre-test scores on the EAS, PHQ-4, and SCORE-15 will be compared between these two groups using independent t tests.
To evaluate whether undergoing FAME coincides with a reduction in parental symptoms of anxiety and depression and improvement in family functioning, differences between the pre- and post-test scores on the SCORE-15 and PHQ-4 will be calculated. If more than 40 participants have completed the pre- and post-test measures, a mixed-design ANOVA will be executed. However, if there is a large amount of missing data, or if less than 40 participants have completed pre-test and post-test measures, two independent t tests will be executed. In addition to statistical significance, it is important to report any meaningful clinical change when studying the impact of an intervention. Calculating the Reliable Change Index (RCI), as proposed by Jacobson and Truax , allows us to do so. Using the RCI, we will calculate whether the differences in the scores between t1 and t3 are greater than the measurement error. A calculated RCI larger than |1.96| indicates a clinically reliable change with 95% certainty. The RCIs allows us to determine the numbers of participants improved, unchanged, and worsened from t1 to t3.
Analysis of qualitative data
All audio-recorded interviews will be transcribed verbatim. Data of the semi-structured interviews will be analysed using the qualitative data analysis software programme MAXQDA 10. The current study uses the General Inductive Approach as proposed by Thomas . The approach is often used in qualitative data analysis. Data analysis is guided by the evaluation objectives. Using the General Inductive Approach for analysing qualitative evaluation data, the following five steps will be conducted: (1) initial reading of the text, (2) identifying specific text fragments related to the research questions, (3) labelling fragments to create categories, (4) reducing overlap and redundancy, and (5) describing the most important categories. These steps will result in three to eight outcome categories capturing the key aspects of the most important themes. Reliability of the qualitative data analysis will be assessed by independent parallel coding by two researchers during step 3 and 5.
Integrating quantitative and qualitative data
Quantitative and qualitative data from each family will be combined in one document. Findings regarding the evaluation of FAME derived from qualitative and quantitative data will be integrated for each family by analysing whether (1) qualitative and quantitative findings lead to similar or different conclusions and (2) qualitative findings can provide more in-depth information to the quantitative findings. In addition, we will compare the qualitative and quantitative findings of all families that took part in the study and analyse whether any differences or similarities exist.
Each family will be linked to an administration number. The data will be saved under the administration numbers on the protected IT environment of the Foundation Centrum ‘45. The data analysis will be performed at the Foundation Centrum ‘45. The handling of personal data complies with the General Data Protection Regulation.
The current study is designed to evaluate the feasibility, acceptability, and potential effectiveness of FAME, a preventive programme for asylum-seeker families. Moreover, potential baseline differences in the parent-child relationship, parental symptoms of anxiety and depression, and family functioning between families living in asylum centres and families living in family facilities are investigated. Although a large body of research supports the idea that family processes, the parent-child relationship, and the community play a central role in the development and well-being of the child, these processes received little attention in preventive interventions developed for these at-risk families . Moreover, no studies have yet evaluated FAME . This study will inform us on how to improve programme elements and the implementation of FAME.
FAME aims to strengthen and support potential resources within and outside of the families. The current study will indicate whether FAME is a feasible and acceptable programme when offered in a naturalistic setting. An important strength of this study is the inclusion of qualitative data, in addition to various quantitative measures. Conducting semi-structured interviews with the participants enables us to hear the voices of the participants about how they experience the programme and whether they feel it has helped them to deal with the consequences of previous and current stressors.
When executing the proposed study, several barriers can be anticipated. For example, when working with asylum-seeker families, we have to keep into account the many relocations the families are faced with. Families living in asylum centres are often placed in another centre or move away from the centre after the asylum has been granted. Families living at family locations risk deportation. These replacements can result in heightened levels of dropout. Moreover, asylum-seekers are faced with post-migration stressors concerning acculturation and resettlement, such as financial issues, language barriers, and facing an insecure future. These continuous stressors might make it difficult to prioritize preventive programmes such as FAME [3, 9]. To deal with these issues concerning recruitment and inclusion, trainers will collaborate with local health teams in order to reach families, inform them about FAME, and remind them of the sessions as best as possible. To further inform families, the initial information session will focus on disclosing the aim of FAME and the study and clarify mutual expectations. Finally, in order to overcome barriers, FAME is offered at the living locations of the families, diminishing travelling costs and time spent travelling. Nevertheless, the current study will not be able to eliminate dropout as a result of factors such as relocation. These barriers underline the need for studying the feasibility of FAME.
The current study holds several limitations. Because of the small sample size and convenience sampling, the results and their generalizability should be interpreted with caution. Moreover, concerning our objective to establish the potential effectiveness of FAME, we will be unable to attribute any potential effects to FAME as a result of the lack of a control group. However, in line with the developmental cycle proposed by Weine , the scope of the current study is not to provide such an extensive evaluation, but to take a next step in the development of a recently developed programme. Possibly, the study will allow us to determine important parameters to estimate the sample size and detectable effect sizes for potential future, larger studies assessing the effectiveness and implementation of FAME.
In conclusion, this is the first study examining the feasibility, acceptability, and preliminary effectiveness of the secondary preventive programme FAME. Our aim is to contribute to the still limited knowledge on preventive programmes for asylum-seeker families. By developing a programme designed to prevent further development of emotional reactions and to improve family functioning, we aim to support these at-risk families preparing for resettlement in a new country, or those facing deportation.
Recruitment commenced in September 2018. The approximate trial duration is 12 months. The trial was registered in the Dutch Trial Register (TC = NTR6934) on January 8 2018 (http://www.trialregister.nl/trial/6723).
((Young) Child) Outcome Rating Scale
((Young) Child) Session Rating Scale
Emotional Availability Scales
Patient Health Questionnaire for Depression and Anxiety
Reliable Change Index
Systemic Clinical Outcome and Routine Evaluation
UNHCR. Global trends: forced displacement in 2017. Geneva: UNHCR; 2018.
Fazel M, Reed RV, Panter-Brick C, Stein A. Mental health of displaced and refugee children resettled in high-income countries: risk and protective factors. Lancet. 2012;379(9812):266–82. Available from: https://doi.org/10.1016/S0140-6736(11)60051-2.
Li SSY, Liddell BJ, Nickerson A. The relationship between post-migration stress and psychological disorders in refugees and asylum seekers. Curr Psychiatry Rep. 2016:1–9 Available from: https://doi.org/10.1007/s11920-016-0723-0.
COA. Typen locatie [Internet]. Cited March 28, 2019. Available from: https://www.coa.nl/nl/opvanglocaties/typen-locaties.
COA, Werkgroep Kind in azc. Leefomstandigheden van kinderen in asielzoekerscentra en gezinslocaties. Woerden: Pharos; 2018.
Mooren T, Bala J. Goed ouderschap in moeilijke tijden: Handleiding voor meergezinsgroepen met vluchtelingen; 2016.
Weine SM, Ware N, Hakizimana L, Tugenberg T, Currie M, Dahnweih G, et al. Fostering resilience: protective agents, resources, and mechanisms for adolescent refugees’ psychosocial well-being. Adolesc Psychiatry (Hilversum). 2014;4(4):164–76.
Fazel M, Wheeler J, Danesh J. Prevalence of serious mental disorder in 7000 refugees resettled in western countries: a systematic review. Lancet. 2005;365(9467):1309–14.
Fazel M, Betancourt TS. Review: Preventive mental health interventions for refugee children and adolescents in high-income settings. Lancet Child Adolesc Health. 2017;4642(November) Available from: https://doi.org/10.1016/S2352-4642(17)30147-5.
Almqvist K, Broberg AG. Young children traumatized by organized violence together with their mothers - the critical effects of damaged internal representions. Attach Hum Dev. 2003;5(4):367–80.
Ee van E, Hein I, Bala J, Mooren T. Multifamily therapy met vluchtelingengezinnen: van oorlog naar veiligheid. Kind Adolesc. 2014;35(3):205–2015.
Allen JG, Fonagy P, Bateman A. Mentalizing in clinical practice. Washington: American Psychiatric Publishing, Inc; 2008.
Fonagy P, Bateman AW. Mechanisms of change in mentalisation-based therapy with BPD. J Clin Psychol. 2006;62(4):411–30.
Laqueur HP, Laburt HA, Morong E. Multiple family therapy. Curr Psychiatr Ther. 1964;4:150–4 [cited 2017 Nov 20]. Available from: http://www.ncbi.nlm.nih.gov/pubmed/14281131.
Lemmens GMD, Eisler I, Buysse A, Heene E, Demyttenaere K. The effects on mood of adjunctive single-family and multi-family group therapy in the treatment of hospitalized patients with major depression: a 15-month follow-up study. Psychother Psychosom. 2009;78(2):98–105. Available from: https://www.ncbi.nlm.nih.gov/pubmed/19218828.
Gelin Z, Cook-Darzens S, Hendrick S. The evidence base for multiple family therapy in psychiatric disorders: a review (part 1). J Fam Ther. 2017;40(3):1–24.
O’Shea MD, Phelps R. Multiple family therapy: current status and critical appraisal. Fam Process. 1985;24(4):555–82. Available from: https://onlinelibrary.wiley.com/doi/abs/10.1111/j.1545-5300.1985.00555.x.
Asen E. Multiple family therapy: an overview. J Fam Ther. 2002;24(1):3–16 Available from: http://doi.wiley.com/10.1111/1467-6427.00197.
Weine SM. Developing preventative mental health interventions for refugee families in resettlement. Fam Process. 2011;50(3):410–30 Available from: http://onlinelibrary.wiley.com/doi/10.1111/j.1545-5300.2011.01366.x/full3989.
Stratton P, Lask J, Bland J, Nowotny E, Evans C, Singh R, et al. Detecting therapeutic improvement early in therapy: validation of the SCORE-15 index of family functioning and change. J Fam Ther. 2014;36(1):3–19.
Hamilton E, Carr A, Cahill P, Cassells C, Hartnett D. Psychometric properties and responsiveness to change of 15- and 28-item versions of the SCORE: a family assessment questionnaire. Fam Process. 2015;54(3):454–63.
Stratton P, Bland J, Janes E, Lask J. Developing an indicator of family function and a practicable outcome measure for systemic family and couple therapy: the SCORE. J Fam Ther. 2010;32(3):232–58.
Löwe B, Wahl I, Rose M, Spitzer C, Glaesmer H, Wingenfeld K, et al. A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. J Affect Disord. 2010;122(1–2):86–95 Available from: https://doi.org/10.1016/j.jad.2009.06.019.
Kroenke K, Spitzer RL, Williams JBW, Lowe B. An ultra-brief screening scale for anxiety and depression: the PHQ-4. Psychosomatics. 2009;50(6):613–21. Available from: https://www.ncbi.nlm.nih.gov/pubmed/19996233.
Biringen Z, Robinson JL, Emde RN. Appendix B: The Emotional Availability Scales (3rd ed.; an abridged Infancy/Early Childhood Version). Attach Hum Dev. 2000;2(2):256–70 Available from: http://www.tandfonline.com/doi/abs/10.1080/14616730050085626.
Biringen Z, Derscheid D, Vliegen N, Closson L, Easterbrooks MA. Emotional availability (EA): theoretical background, empirical research using the EA scales, and clinical applications. Dev Rev. 2014;34(2):114–67 Available from: https://doi.org/10.1016/j.dr.2014.01.002.
Selin H. Parenting Across Cultures_ Childrearing, Motherhood and Fatherhood in Non-Western Cultures. Science Across Cultures: The History of Non-Western Science; 2014. p. XXII. 516
Duncan BL, Miller SD, Sparks JA, Claud DA, Reynolds LR, Brown J, et al. The Session Rating Scale: preliminary psychometric properties of a “ working ” alliance measure. J Br Ther JBT. 2003;3(31):3–12.
Miller SD, Duncan BL, Brown J, J A S, D A C. The outcome rating scale: a preliminary study of the reliability, validity, and feasibility of a brief visual analog measure. J Br Ther. 2003;2(2):91–100.
Carroll C, Patterson M, Wood S, Booth A, Rick J, Balain S. A conceptual framework for implementation fidelity. Implement Sci. 2007;2(1):1–9.
Jacobson NS, Truax P. Clinical significance: a statistical approach to denning meaningful change in psychotherapy research. J Consult Clin Psychol. 1991;59(1):12–9.
Thomas DR. A general inductive approach for analyzing qualitative evaluation data. Am J Eval. 2006;27(2):237–46 Available from: http://journals.sagepub.com/doi/10.1177/1098214005283748.
We would like to thank the participating family members in advance. Moreover, we thank Marieke Sleijpen for her advising role in drafting the study protocol. Finally, we are grateful to Stichting Kinderpostzegels, for facilitating this study.
The study is funded by Stichting Kinderpostzegels.
Availability of data and materials
Ethics approval and consent to participate
Ethical approval has been obtained from the Medical Research Ethics Committee of the Leiden University Medical Centre.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.