Skip to main content

Feasibility of improving child behavioral health using task-shifting to implement the 4Rs and 2Ss program for strengthening families in child welfare

Abstract

Background

Children whose families are involved with child welfare services manifest disproportionately high levels of behavioral difficulties, which could be addressed in community-based organizations providing services to prevent out-of-home placement. Unfortunately, few evidence-based practices have been successfully implemented in child welfare settings, especially those originally delivered by mental health providers. Given that such settings typically employ caseworkers who lack prior mental health training, this is a significant barrier to implementation. Consequently, the overall aim of the current study is to test the feasibility of shifting a mental health intervention from specialized services to community-based organizations. It uses task-shifting and the Practical, Robust, Implementation, and Sustainability model (PRISM) to implement an evidence-based intervention to reduce child behavior difficulties, originally provided by mental health practitioners, so that it can be delivered by caseworkers providing placement prevention services to child welfare-involved families. Task-shifting involves (1) modifying the intervention for provision by non-mental health providers, (2) training non-mental health providers in the modified intervention, and (3) establishing regular supervision and monitoring by mental health specialists.

Methods/design

This study uses the 4Rs and 2Ss Program for Strengthening Families, a multiple family group service delivery model to reduce child behavior difficulties, as the example intervention. This intervention has had prior success with child welfare-involved families. The proposed study objectives are (1) to tailor the content, training, and supervision of the intervention for delivery by caseworkers serving child welfare-involved families and (2) to assess the feasibility and acceptability of the modified intervention. Mixed quantitative and qualitative methods will assess feasibility and acceptability from key stakeholders (caseworkers, supervisors, administrators, caregivers). In phase I, a collaborative advisory board will be convened (1) to modify the intervention to be delivered by caseworkers in placement prevention service settings and (2) to develop training and supervision protocols for caseworkers. In phase 2, the modified intervention will be pilot-tested for delivery by n = 4 caseworkers to n = 20 families receiving placement preventive services (where children manifest behavior problems). Mixed quantitative/qualitative methods will be used to assess feasibility and acceptability.

Discussion

This protocol will be of particular interest to agency administrators, program managers, and researchers interested in developing and testing cross-setting implementation guidelines for similar evidence-based practices.

Peer Review reports

Background

Children who remain at home with their permanent caregivers following a child welfare investigation manifest disproportionately higher rates of behavior problems (e.g., hyperactive, oppositional, disruptive, and/or aggressive behavior [1]) compared to national rates [2, 3]. The current study focuses on this subgroup as it represents the majority of youth involved in child welfare services within the USA [4] but who are less likely to utilize child mental health services compared to youth placed into foster care [5]. Untreated, such behavioral problems are a costly (up to tenfold increase) [6] public health concern as they also create additional service needs due to increased risk for future maltreatment [7, 8], out-of-home placement [9], high school dropout [10], and delinquency [11]. Effective evidence-based practices (EBPs), such as behavioral parent training interventions [12, 13] known to successfully reduce child behavior difficulties, are needed particularly for those families who are identified as high risk, but where there remains the possibility of averting a traumatizing out-of-home placement, as well as reducing the risk of other future maladaptive outcomes.

Many such behavioral parent training programs are offered in child mental health settings. However, reduction of maltreatment risk and improving family stability through parent training fall well within the purview of community-based organizations (CBOs) which provide a comprehensive array of placement prevention services (also known as “in home family preservation,” “preventive services”) for families mandated or referred by child welfare authorities following maltreatment investigations [14, 15] as well as a small proportion of families with similar difficulties voluntarily seeking services [16]. Rather than refer families to separately housed (and often overburdened [17]) child mental health providers, CBOs are logical platforms for effective interventions to reach child welfare-involved children with behavior problems. At the same time, many such EBPs were originally designed to be delivered by advanced mental health providers (e.g., Parent-child interaction therapy [13]), a substantial implementation barrier, given that the typical child welfare workforce includes a sizable proportion of caseworkers lacking advanced specialized mental health training [18, 19].

Despite recent efforts to implement EBPs developed for small clinics in child welfare settings [14, 20], there is limited guidance available about successful strategies for implementing EBPs from one service setting to another [21, 22]. In addition to lacking ancillary psychiatric support or providers with extensive mental health backgrounds, caseworkers have sizeable workloads and multiple responsibilities, with few available avenues to support knowledge sharing [23, 24]. CBOs also differ from child mental health settings with regard to perceived roles and responsibilities among staff, consumer characteristics, fiscal and regulatory requirements, and the capacity of organizations to integrate innovation into practice as well as state-specific licensure and certification laws which may prohibit formal mental health treatment by non-licensed individuals. As a result, modifying intervention processes to align with caseworkers’ scope of practice may be necessary as well as subsequent evaluation of the adapted model’s feasibility, acceptability, and effectiveness [22, 25]. In addition, partnering with community stakeholders (e.g., consumers, providers) and EBP experts around adapting intervention processes and materials, increasing agency capacity, and developing collaborative partnerships can leverage differing stakeholder competencies in the service of promoting successful implementation and outcomes [21, 22, 26].

The current study attempts to increase guidance regarding cross-setting adaptations and implementation processes. Specifically, task-shifting strategies [27] and the Practical, Robust, Implementation, and Sustainability Model (PRISM [28]) are utilized to modify the 4Rs and 2Ss for strengthening families program (4R2S), an evidence-based multiple family group service delivery model to reduce child behavioral difficulties, for implementation in CBOs serving families involved in placement prevention services. The modified intervention will subsequently be pilot-tested for feasibility and acceptability.

Task-shifting

Endorsed by the World Health Organization (WHO) for use by developing countries with shortages in mental health professionals, task-shifting involves redistributing tasks from professionally trained workers to those with less training and fewer qualifications [27]. As illustrated in Fig. 1, successful task-shifting efforts [2932] in the developing world have involved (1) modifying the intervention to be delivered by non-mental health workers in their existing settings (e.g., simplifying language, length, service delivery modality), (2) training non-mental health workers, and (3) providing consistent supervision for task-shifted non-mental health workers by competent mental health providers. As a result, task-shifting strategies have successfully reduced adult depression using Cognitive Behavior Therapy and Interpersonal Psychotherapy in Pakistan, Uganda, India, and South Africa by a host of lay-level providers [29, 3335]. Most importantly, the beneficial effects were achieved by continuously supervised [35] workers with no mental health background and relatively short training (as little as 2 days [31, 32, 34]). Within the USA, task-shifting from highly trained professionals to providers with less training and experience has been used in efforts to improve dental care in rural settings (NIH Grant R36HS019117-01A1), promote healthy body image among college undergraduates [36], provide behavioral parent training for low-income families in Head Start [37], and increase access to services for aging individuals with dementia [38] as well as numerous efforts shifting tasks from physicians to lesser-skilled health professionals (e.g., nurses) to increase access to medical services [3942]. To the author’s knowledge, task-shifting has yet to be used to implement EBPs from child mental health to the child welfare service sector, where mental health specialists are not typically employed. In the current study, task-shifting will provide an overarching conceptual framework to translate mental health clinicians’ skills and strategies so that they can be used by caseworkers while maintaining compliance with licensure-related restrictions on scope of practice.

Fig. 1
figure 1

Task-shifting strategies. Successful task-shifting efforts to increase access to mental health treatment which in the developing world involve (1) modifying the original intervention so that it can be delivered to non-mental health specialists and in the contexts within which they work; (2) training non-mental health specialists in the modified intervention, and (3) providing regular supervision with a mental health specialist [2932]

PRISM

Specific modifications to the intervention, development of training and supervision protocols, and measurement will be further guided by PRISM, a practical, robust, and prescriptive model built upon multi-disciplinary implementation models. Table 1 documents the PRISM domains and elements of interest to maximize implementation success and identifies potential areas of modification for the current study. PRISM emphasizes multiple domains that should be considered in order to promote implementation success. Specifically, PRISM domains will specify aspects within the task-shifting approach (i.e., intervention modification, training, and supervision) that will be addressed to support implementation success across CBOs. Moreover, PRISM domains guide measurement of feasibility and acceptability in the proposed study. Although the PRISM framework has been frequently cited within the implementation literature as informing studies, the author is unaware of any studies which utilize PRISM as a conceptual framework informing implementation in the child welfare service sector. Moreover, PRISM is utilized in the current study as a framework for intervention adaptation into a new setting such that the resulting modified 4R2S intervention is maximized for subsequent implementation success. Such use of an implementation framework may be increasingly necessary to guide basic intervention development in order to increase the likelihood that newly developed interventions are integrated into everyday practice. This study focuses on PRISM domains emphasizing intervention perspectives, recipient characteristics, and the external environment. Once feasibility and acceptability are established, the next stage in this line of research will be to conduct a larger-scale study incorporating multiple CBOs, addressing the PRISM domain focused on implementation and sustainability infrastructure, and examining implementation and intervention effectiveness outcomes.

Table 1 PRISM domains, elements, and anticipated modification/development focus

The 4Rs and 2Ss for strengthening families program

Finally, this study utilizes the 4Rs and 2Ss for strengthening families program (4R2S) to reduce child behavior difficulties as an example EBP (also known as “Multiple Family Groups for Children with Disruptive Behavior Disorders”). This program is currently listed on the Substance Abuse and Mental Health Services Administration’s (SAMHSA) National Registry of Evidence-based Programs and Practices (NREPP; http://nrepp.samhsa.gov/ProgramProfile.aspx?id=41#hide1). 4R2S consists of weekly sessions of multiple family groups (six to eight families) convened over 4 months, where engagement is promoted via extensive phone outreach, childcare, transportation expenses, and a meal provided at each session. Core treatment components integrate two decades of research regarding (1) caregiver engagement in child mental health treatment as well as (2) behavioral parent training and family therapy strategies that address empirically supported family-level influences on disruptive behavior disorders (see Table 2). This intervention is an ideal example of an EBP to use in this study as 4R2S (1) has already been successfully delivered using facilitator teams which include at least one mental health clinician and a non-professional parent advocate (parent consumers of child mental health services) [4348]; (2) prioritizes engagement and retention of low-income, minority families by targeting logistical (i.e., lack of transportation and childcare, conflicting demands), and perceptual barriers (i.e., stigma) to service use [4951]; (3) is manualized for straightforward delivery by community-based providers; (4) exemplifies similar EBPs well-known to reduce child behavior difficulties; and (5) does not require specialized placement (i.e., multidimensional treatment foster care [52]) or costly space/equipment requirements (i.e., parent-child interaction therapy [13]).

Table 2 Summary of empirically supported family-level influences on ODD and CD

Moreover, 4R2S has demonstrated benefits for child behavioral difficulties, functional capacities, and family processes [43, 4548, 53, 54] in a recently completed effectiveness trial involving a sample of 320 low-income, predominantly minority (Black/African American, Latino) adult caregivers and children (ages 7–11) evidencing oppositional defiant disorder or conduct disorder. Forty percent of participant caregivers indicated having prior or current child welfare involvement at baseline. Compared to participants receiving services as usual (e.g., individual therapy, family therapy), at post-test, participants reported significantly reduced child disruptive behavior difficulties (Cohen’s d = 0.35) and increased child social skills (Cohen’s d = 0.32). At 6 months’ follow-up, participants who received 4R2S continued to report significantly reduced child behavior difficulties (Cohen’s d = 0.34), as well as decreased functional impairment on peer relations (Cohen’s d = 0.27), when compared to participants receiving services as usual [43, 53]. Families involved in child welfare services within this sample manifested similar rates of attendance compared to families not involved in child welfare services [55]. Moreover, families involved in child welfare services who received 4R2S reported significantly reduced child behavior difficulties (Cohen’s d = 0.61), and functional impairment on peer relations (Cohen’s d = 0.44) at 6 months’ follow-up, when compared to child welfare-involved families receiving services as usual [56].

Primary objectives

The overall aim of the current study is test the feasibility of shifting a mental health intervention from specialized child mental health services to community-based child welfare organizations.

Objective 1

The first objective of this study uses a task-shifting framework and PRISM to modify the content, training, and supervision of 4R2S for delivery by child welfare caseworkers in a CBO providing placement prevention services to families and their children with behavior problems. Additionally, task-shifting and PRISM will guide any changes to existing CBO caseload structure and workload in order to promote successful implementation of the modified 4R2S.

Objective 2

The second objective of this study is to assess the feasibility and acceptability of the modified 4R2S in a CBO providing placement prevention services.

Methods/design

Phase I (objective 1)

Participants and settings

To accomplish objective 1, relevant stakeholders invited to consult on the collaborative advisory board (CAB) will include n = 2 caseworkers, n = 2 supervisors, n = 2 agency administrators from CBOs providing placement prevention services, and n = 3 parent consumers of placement prevention services. Additional CAB members will include research staff who have had extensive clinical experience conducting the 4R2S intervention. Specifically, the CAB will meet regularly over a period of 4–6 months to modify the 4R2S intervention to create guidelines for ensuring intervention quality and feasibility based on existing task-shifting literature [27, 2932, 34, 35, 57].

Modification of the 4R2S intervention

The CAB will be charged with (1) modifying the existing 4R2S intervention for delivery by CBO caseworkers and identifying any potential changes needed to be made within the CBO to support implementation as well as (2) developing a protocol for training and (3) a mental health supervision framework of CBO caseworkers. This process will be informed by the task-shifting framework (see Fig. 1) and the following PRISM domains: intervention perspectives (e.g., perceived burden, usability/adaptability, barriers), recipient characteristics (e.g., existing staffing capacities, child/family mental health needs, competing demands and barriers), and external environment (e.g., child welfare authority performance indicators, community resources). Research staff will take detailed written field notes of the CAB process (e.g., decision-making, final products) and summarize raw written notes into a structured observation guide [58, 59] with pre-specified headings based on task-shifting strategies as well as PRISM domains and elements (e.g., domain I: considering the intervention from the organization’s perspective) to assist with making subsequent modifications to the intervention, training, and supervision.

CAB sessions are structured to first provide orientation to the overall study. Strategies include team-building exercises and didactic review of study background and procedures as well as didactic and experiential training in the initial 4R2S intervention curriculum sessions. CAB members are subsequently instructed to provide verbal and written feedback that addresses task-shifting strategies and PRISM domains and elements for each session. Secondly, research staff will engage CAB members in a series of discussions focused on addressing the overall 4R2S intervention structure and processes, implementation into the CBO context, as well as caseworker training and supervision. Discussion points are informed by task-shifting strategies and PRISM domains focused on intervention perspectives, recipient characteristics, and external environment. Finally, CAB members will review and provide feedback on all research materials (e.g., recruitment materials, surveys, focus group guides) to ensure readability and acceptability for potential participants.

Subsequent modifications to the 4R2S intervention, training, and supervision will incorporate CAB feedback, methods, and findings from prior studies [43, 44, 5355, 60] as well as collaboration with 4R2S developers to ensure core concepts and processes are maintained during the modification process. Recommendations from the CAB to alter existing caseload and/or workload structures will be negotiated between research staff and CBO administration in order to maximize implementation success.

Training for case workers

Training for caseworkers will integrate recommendations from the extant literature on task-shifting [27, 2931, 34, 35], implementation science [61], and training for EBPs [62, 63]. As a result, training will include a mixture of (1) didactic instruction on child mental health issues and related family factors, engagement and group facilitation skills, and safety protocols for potential medical and psychiatric emergencies; (2) active and participatory learning strategies (e.g., practice, modeling, role-play, and vicarious learning); (3) provision of an easy-to-follow manual; and (4) ongoing supervision by 4R2S experts. As the original 4R2S intervention were co-led with mental health clinicians, many of whom had substantial expertise in group and family work, supervision with caseworkers will initially focus on adherence to the 4R2S intervention model. However, as caseworkers in the current study will not have had prior mental health training, supervision protocols will further incorporate Stoltenberg’s Integrated Developmental Model [64], which will allow supervisors to monitor and adjust the quality of supervision according to supervisee development (i.e., changes in self and other awareness, motivation, autonomy). For example, supervision in the early part of the task-shifted 4R2S intervention may focus on increasing caseworkers’ confidence and motivation, managing anxieties and frustrations, and providing a high level of structure and direction regarding the clinical skills needed to deliver 4R2S (e.g., conducting group-level interventions, managing child and adult behavior within group sessions) as well as adherence to the intervention model. As caseworkers become more proficient and confident, supervision is likely to shift so that caseworkers develop greater understanding of their clients’ world from cognitive and affective perspectives.

Following the completion of all modifications and development of training/supervision, all revised research materials and procedures will be re-submitted for approval at all participating institutional review boards (IRBs).

Phase II (objective 2)

In phase II, n = 4 caseworkers at a participating CBO will be trained to deliver 4R2S to n = 20 caregivers/n = 20 youth receiving placement preventive services at CBOs and whose children manifest disruptive behavior difficulties. Quantitative and qualitative approaches will be used to gather information from caseworkers, supervisors, agency administrators, and caregivers to assess feasibility and acceptability.

Population

This study will consist of four purposively selected samples: n = 4 caseworkers, n = 4 supervisors, n = 2 administrators, n = 20 youth with behavior difficulties, and their caregivers (n = 20). Sample sizes for caregivers and youth account for an estimated 20 % attrition rate (overestimating the 10 % attrition from the 4R2S effectiveness study [43, 53]), so that each 4R2S group will contain at least eight families. Although larger sample sizes were considered, smaller samples are sufficient in order to obtain detailed data to establish initial feasibility and acceptability. Such information will be subsequently utilized to revise the modified 4R2S prior to testing in a larger-scale study. A purposive sampling strategy was chosen rather than random selection due to the small sample sizes and desire to enroll engaged participants who can provide important information on feasibility and acceptability.

Caseworkers inclusion criteria

Eligible caseworkers (age 21 and older) include n = 4 caseworkers who are (1) employed in a CBO contracted to provide placement prevention services, (2) English-speaking, (3) have completed a bachelor’s-level degree, and (4) have had no prior mental health training (e.g., post-graduate training and/or employment as a mental health clinician, clinical licensure).

CBO supervisors inclusion criteria

Eligible CBO supervisors (age 21 and older) include n = 4 supervisors who (1) supervise the caseworkers enrolled in the current study, (2) are English speaking, and (3) employed at the CBO participating in this study. CBO supervisors are not required to have prior mental health training.

CBO administrators inclusion criteria

Eligible CBO administrators (age 21 and older) include n = 2 administrators who (1) hold an executive leadership role within the CBO participating in the study, (2) are English-speaking, and (3) employed at the CBO participating in this study.

Identified child inclusion criteria

Eligible youth include n = 20 children (hereafter referred to as “identified child”) whose permanent caregiver receives placement prevention services at a CBO. Multiple methods will be utilized for screening children who manifest a range of disruptive behavior difficulties who might not be selected if relying on a single screening strategy. This study will enroll English-speaking children ages 7–11 (based on original 4R2S effectiveness study criteria) who meet one or more of the following inclusion criteria: (1) caregiver report of the presence of serious disruptive behavior difficulties using the disruptive behavior disorders (DBD) rating scale [65] (e.g., meeting symptom criteria for oppositional defiant or conduct disorders) and (2) history of out-of-home placement in the past year due to the child’s disruptive behavior difficulties. As a result, these youth may include those temporarily placed in foster care but returned to their permanent caregivers at the time of initial consenting.

Caregivers inclusion criteria

Eligible caregivers (hereafter referred to as “legal guardian/primary caregivers”) include up to n = 20 adult caregivers (age 21 and older) (1) who are receiving placement prevention services, (2) have a child meeting above criteria, and (3) are English-speaking. If more than one caregiver or child is present and willing to participate in the study, they will both be consented, but only one caregiver will be the data reporter for the family. Research staff will record the number of families screened and subsequently enrolled.

Exclusion criteria

Potential family (e.g., caregiver, identified child) participants will be excluded from the study if they present with significant cognitive impairment (as reported by CBO staff) that interferes with understanding the informed consent process. Moreover, for participants with emergency psychiatric needs that require services beyond those within an outpatient setting (e.g., hospitalization, specialized placement outside the home), needed care will be secured rather than study participation. However, if participants are able to remain in the permanent home following an emergency psychiatric evaluation, they may be eligible to participate.

Recruitment and screening procedures

To recruit caseworkers, supervisors, and agency administrators for phase II, research staff will make multiple presentations at staff and management meetings. Visually appealing fliers will be provided to CBO staff to give to potential participant families (identified child, legal guardian/primary caregiver). Additionally, research staff will have a strong on-site presence at the CBO to provide as-needed informational sessions on the study. All interested individuals may contact research staff directly or allow their contact information to be released to research staff. Finally, research staff will provide in-depth information about the study as well as obtain informed written consent (adult participants) and assent (child participants). Once potential family participants (identified child, legal guardian/primary caregiver) have provided written consent, research staff will administer a screening questionnaire to determine if caregivers and youth are eligible for the study. Of those families deemed eligible to participate in the study, research staff will inform them that additional primary caregivers and siblings may attend 4R2S groups, and will need to be consented/assented as well. Legal guardian/primary caregivers can establish individual meetings with research staff in order to consent/assent additional primary caregivers (aged 21 and older, additional caregiver to identified child) and siblings (6–18 years old, sibling to identified child).

Setting

The proposed setting is a publicly funded CBO offering placement prevention services to families. This is a different CBO than those employing CAB members from phase I, allowing for consideration of a greater diversity of contextual factors than using the same CBO that employed CAB members. Convenience sampling was utilized, such that research staff approached the state child welfare authority regarding implementing phase II, who subsequently disseminated study information to various jurisdictional authorities in the state. After meeting with several representatives from each interested jurisdiction, the current CBO was chosen as the sole research site due their ability to implement the study within the time constraints of the current grant funding. The placement prevention program, called “in home family preservation,” focuses on stabilizing families and reducing the likelihood of foster care entry. This is accomplished through the direct provision, coordination, or referral to services such as counseling, medical and psychological evaluation, parenting classes, and entitlement assistance to families referred as a result of maltreatment allegations, as well as families voluntarily seeking services.

Measures

Measures and related study constructs are presented in Table 3. In addition to project-developed measures, the proposed study also uses measures that were previously incorporated in the 4R2S effectiveness study [43, 53]. The DBD rating scale assesses if children meet DSM-5 [66] diagnostic criteria for oppositional defiant disorder, or conduct disorder. Psychometrics of the DBD indicate acceptable test-retest reliability before and after treatment (r = 0.49–0.61) and good internal consistency (Cronbach’s alpha = 0.82–0.92). As a measure of concurrent validity, the correlation between the DBD and measures of impairment ranges from 0.79 to 0.93 [65, 67]. The Kazdin barriers to treatment (KBT) scale is a useful measure for understanding the specific barriers to accessing treatment. In addition to looking at the overall average score and comparing to the project-defined cutoff levels, individual items which may be most endorsed by caregiver participants (e.g., “My child refused to come to session”) can be examined in order to inform subsequent intervention modification. Internal consistency for the overall score for experimental participants from the 4R2S effectiveness study was high (Cronbach alpha = 0.94) [55]. The Metropolitan Area Child Study (MACS) Treatment Program Satisfaction Scale further provides a quantitative measure of participant acceptability for the task-shifted 4R2S intervention. Among experimental participants from the 4R2S effectiveness study, good internal consistency was noted at the mid-point and immediately following the 4R2S intervention (Cronbach alpha = 0.88–0.95) [55].

Table 3 Measurement and analysis of objective 2

Additional measures are also incorporated in the current study. Subscales of the Organizational Readiness for Change (ORC) [68] will measure training needs, adaptability, orientation to change, stress, and efficacy among CBO staff. The Evidence-Based Practice Attitudes Scale (EBPAS) assesses how CBO staff would respond in the future to implementing 4R2S and other EBPs. As reported in a series of articles [6971], the EBPAS demonstrates moderate to good internal consistency for the total score (Cronbach alpha 0.74–0.79). Finally, the Lyons Acceptability, Feasibility, and Appropriateness Scale (LAFAS) provides a quantitative measure of feasibility and acceptability. No psychometric information is currently available for the LAFAS.

Research procedures

Baseline surveys

All consented and eligible participants will complete baseline surveys which assess for demographic information, attitudes towards evidence-based practice, and organizational readiness for change and training needs (CBO staff only) as well as child welfare involvement history (legal guardian/primary caregivers only).

Training caseworkers and supervisors

Existing training methods from prior effectiveness trial and statewide dissemination of 4R2S [43, 45, 53, 60] will be tailored for use with CBO caseworkers. Such methods involve training service providers and at least one supervisor per site. Training for caseworkers and supervisors will be based on procedures and content developed during phase I of this study. Training will cover the 4R2S model’s core competencies (see Table 2), group facilitation and engagement skills, as well as any additional content identified during phase I CAB recommendations, via a mixture of didactic lecture, group discussion, and role-play. Caseworkers and supervisors will complete a 4R2S knowledge and skills test. Caseworkers who do not pass at the 80 % level will be provided as-needed booster training and be allowed to re-take the test. Only those who pass the test will be allowed to be involved in the study. Caseworker training for the task-shifted 4R2S intervention will be tracked via total number of hours, number of attendees, content covered, and written feedback from caseworkers and supervisors for additional modifications.

Conducting 4R2S groups

Following training, CBO caseworkers will deliver the refined and adapted 4R2S intervention to families at the CBOs or possibly in the participants’ residence for missed sessions. 4R2S will be delivered such that two groups will be conducted in the participating CBO. However, each group will be facilitated by two different pairs of caseworkers (two groups total, four caseworkers total). Consequently, two new supervisors and one new administrator will recruited for data collection involving the second group. The length of the resulting task-­shifted 4R2S intervention and mode of delivery (multiple family groups only held at CBOs or groups plus home­based service delivery) will depend on guidance from the CAB. At this time, the original 4R2S intervention is held in weekly group sessions involving approximately six to eight families (at least two generations per family present) over the course of 4 months. At each session, families are provided with childcare for younger children (under 6 years old), refreshments, and transportation expenses. Research staff will ensure that all caseworkers have sufficient materials and resources to conduct 4R2S groups. Meals, childcare, and transportation costs will be covered for all participants at each 4R2S session.

During the course of delivering the task-­shifted 4R2S intervention (up to 4 months), all group sessions will be observed via telephone or web-­based video streaming by research staff in order to complete treatment fidelity rating forms and record session attendance. Additionally, caseworkers will participate in weekly 1-h long conference calls led by research staff (including mental health clinicians with advanced training in child mental health treatment and expertise in the 4R2S intervention) for supervision. Following each 4R2S supervision call, research staff will document the quantity and quality of the supervision call as well as any recommendations for intervention, training, or supervision modification. Research staff will also take written notes during these supervision calls in order to provide real-time insights to research staff on implementation progress. Any challenges noted during each call will allow research staff to provide ongoing problem-solving support in order to facilitate implementation success.

Post-test assessment

Upon completion of the task-­shifted 4R2S intervention, CBO caseworkers, supervisors, administrators, and legal guardian/primary caregivers will complete quantitative measures (feasibility, acceptability) as well as participate in separate, homogeneous, audio-recorded focus groups (e.g., caregivers only) or individual interviews (see Table 3 for sample questions).

Following completion of post­test assessments (surveys and focus groups/interviews), research staff will record the information extracted from the CBO’s administrative records for each family regarding referral status, associated maltreatment allegations, casework contacts, service goals and services received, prior out-of-home placement and associated allegations.

Analytic plan

Quantitative and qualitative results will be integrated during analysis to complement each other in a QUANT→QUAL (given fidelity and attendance will be recorded first) design [72].

Quantitative measures and analysis

Table 3 presents information on constructs, corresponding PRISM domains, measures, informants, timing, and methods of analyses. Univariate statistics (means, SD, frequencies) as well as percentages of participants reporting project-defined benchmarks for high feasibility (HF) and acceptability (HA) will be computed. The modified 4R2S will be considered feasible and acceptable if the majority of responses (>50 %) exceed the HF and HA benchmarks.

Qualitative methods and analysis

All audio-recorded focus group/interviews will be transcribed verbatim. Written transcripts will be reviewed for accuracy. All written transcripts, as well as all other study documentation (e.g., field interviewer notes, supervisor call notes) will be coded and analyzed using methods by Morgan and Kitzinger [7376]. Specifically, an initial codebook will be developed by drawing together and comparing a priori (e.g., feasibility, acceptability, external environment, perceptions of the intervention, recipient characteristics) and emergent themes. Rapid qualitative assessment strategies will also be incorporated, which involve documenting initial case summaries categorized by a priori codes [77], as well as remaining open to the emergence of new and unexpected themes. Codes across respondents will be compiled based upon the topics of feasibility and acceptability. For example, a content code “barriers” will be included to identify any content reflecting obstacles to utilizing task-shifting or implementing 4R2S. Codes may be modified as new data are analyzed (i.e., dividing “barriers” into multiple codes such as “system barriers” regarding any organizational obstacles to delivery and “caregiver barriers” for any caregiver-related impediments). A report detailing overall experiences and differences will be compiled by respondent type.

Mixed-methods integration

Quantitative and qualitative data will be collected sequentially (quantitative followed by qualitative) and analyzed separately, but focused on answering the overarching and specific research questions being addressed. Research staff will integrate both data types at the interpretation stage of analysis. Quantitative data will be visually juxtaposed (see Table 3) next to relevant qualitative themes in order to aid in interpretation of the combined findings. For example, a research question is whether the modified 4R2S intervention is feasible for CBOs providing child welfare services. Both quantitative and qualitative results will be placed side-by-side in order to compare and contrast, thus determining whether they support convergence (i.e., results confirm each other) or expansion (i.e., results generate additional information about what factors promote or limit feasibility and acceptability).

Ethical approval

Institutional review board (IRB) protocol approvals for this study have been obtained from the University of Maryland, Baltimore and the Maryland Department of Human Resources. Both protocols will be kept current.

Discussion

Information gathered from phase I written notes will be compiled into preliminary guidelines documenting the process, successes, and “lessons learned” when utilizing task-shifting strategies. To date, main modifications to the 4R2S intervention for implementation in child welfare include: reducing the length of the model to 9–13 sessions, providing optional instructions if sessions are conducted individually with families during home visiting, addressing literacy concerns by enhancing text size and utilizing more visual information in the intervention manual used by families, adding additional intervention and training content requested by the CAB (e.g., confidentiality concerns, access to local parent advocate information, trauma-informed principles, mindfulness exercises, group and child management). Additionally, organizational-level recommended changes included temporary caseload reduction for group facilitators. Findings from phase I will be disseminated in a future manuscript currently under development.

Phase II processes will provide data on initial feasibility and acceptability, as well as solidify methods (e.g., manual, training, supervision, enrollment) to support a larger-scale study testing the effectiveness and implementation success of task-shifting in CBOs. Overall practical and operational issues involved in performing the study (e.g., obtaining multiple IRB approvals, engaging hard-to-reach participants) will also be discussed as part of barriers and challenges to performing this type of research. In the larger-scale study, implementation and sustainability infrastructure will be addressed, as well as average cost estimates across several different CBOs.

It is acknowledged that a single CBO site is a limitation of the current study, as the contextual factors on implementation and outcomes may vary across different organizations. However, the current study is a first step towards understanding initial feasibility and acceptability of implementing the 4R2S intervention in a child welfare context. The planned larger-scale study will build on these findings by using multiple CBO’s, which will ideally be chosen to reflect a range of organizational contexts (e.g., implementation readiness, culture, climate, size). This study innovatively utilizes task-shifting strategies drawn from international public health efforts to scale-up EBPs in low-resource countries. To the authors’ knowledge, task-shifting has yet to be used to implement child mental health EBPs in child welfare settings. An additional innovation involves the use of PRISM to guide the study’s design and evaluation. Refinement of task-shifting and PRISM strategies can add to the growing arsenal of implementation strategies [78] that could be used as components within comprehensive, multi-level approaches to promote successful EBP implementation. The proposed study will provide generalizable knowledge about using methods to facilitate cross-setting implementation for similar EBPs. Such strategies may also provide an innovative way to increase EBP access and reduce costs within transforming child-serving systems.

Current status of study

To date, all phase I activities have been completed, all appropriate IRB approvals have been obtained, and phase II procedures are underway.

Abbreviations

4R2S:

4Rs and 2Ss for strengthening families program

CAB:

collaborative advisory board

CBOs:

community-based organization

CW:

child welfare

DBD:

disruptive behavior disorder (rating scale)

EBPs:

evidence-based practices

HA:

high acceptability

HF:

high feasibility

PRISM:

Practical, Robust, Implementation, and Sustainability Model

References

  1. Hinshaw SP, Lee SS. Oppositional defiant and conduct disorder. In: Mash EJ, Barkley RA, editors. Child psychopathology. 2nd ed. New York: Guilford Press; 2002. p. 144–98.

    Google Scholar 

  2. Administration for Children & Families. CPS sample component wave 1 data analysis report. 2005.

    Google Scholar 

  3. Achenbach TM. Integrative guide for the 1991 CBCL/4-18, YSR, and TRF profiles. Burlington, VT: University of Vermont, Department of Psychiatry; 1991.

    Google Scholar 

  4. Casanueva C, Ringeisen H, Wilson E, Smith K, Dolan M. NSCAW II baseline report: child well-being. OPRE Report #2011-27b. Washington, DC: Office of Planning, Research and Evaluation, Administration for Children and Families, U.S. Department of Health and Human Services; 2011.

    Google Scholar 

  5. Leslie LK, Hurlburt MS, James S, Landsverk J, Slymen DJ, Zhang J. Relationship between entry into child welfare and mental health service use. Psychiatr Serv. 2005;56(8):981–7.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Scott S, Knapp M, Henderson J, Maughan B. Financial cost of social exclusion: follow up study of antisocial children into adulthood. Br Med J. 2001;323(7306):191–4.

    Article  CAS  Google Scholar 

  7. Barth RP. Preventing child abuse and neglect with parent training: evidence and opportunities. Future Child. 2009;19(2):95–118.

    Article  PubMed  Google Scholar 

  8. Videka L, Gopalan G, Bauta B. Child abuse and neglect. In: Gitterman A, editor. Handbook of social work practice with vulnerable populations. 3rd ed. New York: Columbia University Press; 2014.

    Google Scholar 

  9. Barth RP, Wildfire J, Green RL. Placement into foster care and the interplay of urbanicity, child behavior problems, and poverty. Am J Orthopsychiatry. 2006;76(3):358–66.

    Article  PubMed  Google Scholar 

  10. Cairns R, Cairns B, Neckerman H. Early school drop-out: configurations and determinants. Child Dev. 1989;6(60):1437–52.

    Article  Google Scholar 

  11. Loeber R, Burke J, Pardini DA. Perspectives on oppositional defiant disorder, conduct disorder, and psychopathic features. J Child Psychol Psychiatry. 2009;50(1–2):133–42.

    Article  PubMed  Google Scholar 

  12. Linares LO, Montalto D, Li M, Oza VS. A promising parenting intervention in foster care. J Consult Clin Psychol. 2006;74(1):32–41.

    Article  PubMed  Google Scholar 

  13. Chaffin M, Silovsky JF, Funderburk B, et al. Parent-child interaction therapy with physically abusive parents: efficacy for reducing future abuse reports. J Consult Clin Psychol. 2004;72(3):500–10.

    Article  PubMed  Google Scholar 

  14. Hurlburt M, Barth RP, Leslie LK, Landsverk JA, McCrae JS. Building on strengths: current status and opportunities for improvement of parent training for families in child welfare services. In: Haskins R, Wulczyn FH, Webb MB, editors. Child protection: Using research to improve policy and practice. Washington, D.C.: Brookings; 2007. p. 81–106.

    Google Scholar 

  15. Barth RP, Crea TM, John K, Thoburn J, Quinton D. Beyond attachment theory and therapy: towards sensitive and evidence-based interventions with foster and adoptive families in distress. Child Fam Soc Work. 2005;10(4):257–68.

    Article  Google Scholar 

  16. Citizen’s Committee for Children. Keeping track of New York City’s children. 9th ed. 2010.

    Google Scholar 

  17. Asen E. Multiple family therapy: an overview. J Fam Ther. 2002;24(1):3–16.

    Article  Google Scholar 

  18. Aarons GA, Fettes DL, Flores LE, Sommerfeld DH. Evidence-based practice implementation and staff emotional exhaustion in children’s services. Behav Res Ther. 2009;47(11):954–60.

    Article  PubMed  PubMed Central  Google Scholar 

  19. Aarons GA, Sommerfeld DH. Leadership, innovation climate, and attitudes toward evidence-based practice during a statewide implementation. J Am Acad Child Adolesc Psychiatry. 2012;51(4):423–31.

    Article  PubMed  Google Scholar 

  20. Marcynyszyn LA, Maher EJ, Corwin TW. Getting with the (evidence-based) program: an evaluation of the incredible years parenting training program in child welfare. Child Youth Serv Rev. 2011;33(5):747–57.

    Article  Google Scholar 

  21. Breslau ES, Weiss ES, Williams A, Burness A, Kepka D. The implementation road: engaging community partnerships in evidence-based cancer control interventions. Health Promot Pract. 2014:16(1):46-54.

  22. McKleroy VS, Galbraith JS, Cummings B, et al. Adapting evidence-based behavioral interventions for new settings and target populations. AIDS Educ Prev. 2006;18(4):59–73.

    Article  PubMed  Google Scholar 

  23. Yoo J, Brooks D, Patti R. Organizational constructs as predictors of effectiveness in child welfare interventions. Child Welfare. 2007;86(1):53–78.

    PubMed  Google Scholar 

  24. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health Ment Health Serv Res. 2011;38(1):4–23.

    Article  Google Scholar 

  25. Proctor EK, Rosen A. From knowledge production to implementation: research challenges and imperatives. Res Soc Work Pract. 2008;18(4):285–91.

    Article  PubMed  PubMed Central  Google Scholar 

  26. Proctor EK, Landsverk J, Aarons G, Chambers D, Glisson C, Mittman B. Implementation research in mental health services: an emerging science with conceptual, methodological, and training challenges. Adm Policy Ment Health Ment Health Serv Res. 2009;36(1):24–34.

    Article  Google Scholar 

  27. World Health Organization [WHO]. Task-shifting: rational redistribution of tasks among health workforce teams: global recommendations and guidelines. Geneva, Switzerland: WHO Document Production Services; 2008.

    Google Scholar 

  28. Feldstein AC, Glasgow RE. A practical, robust implementation and sustainability model (PRISM) for integrating research findings into practice. Jt Comm J Qual Patient Saf. 2008;34(4):228–43.

    PubMed  Google Scholar 

  29. Verdeli H, Clougherty K, Bolton P, et al. Adapting group interpersonal psychotherapy for a developing country: experience in rural uganda. World Psychiatry. 2003;2(2):114–20.

    PubMed  PubMed Central  Google Scholar 

  30. Rahman A. Challenges and opportunities in developing a psychological intervention for perinatal depression in rural Pakistan—a multi-method study. Arch Womens Ment Health. 2007;10(5):211–9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  31. Patel V, Weiss HA, Chowdhary N, et al. Effectiveness of an itnervention led by lay health counselors for depressive and anxiety disorders in primary care in Goa, India (MANAS): a cluster randomized controlled trial. Lancet. 2010;376:2086–95.

    Article  PubMed  Google Scholar 

  32. Petersen I, Ssebunnya J, Bhana A, Baillie K, MhaPP Research Programme Consortium. Lessons from case studies of integrating mental health into primary health care in south africa and uganda. Int J Ment Heal Syst. 2011;5:Art 8–12.

    Article  Google Scholar 

  33. Petersen I, Bhana A, Baillie K. MhaPP Research Programme Consortium. The feasibility of adapted group-based interpersonal therapy (IPT) for the treatment of depression by community health workers within the context of task shifting in south africa. Community Ment Health J. 2012;48(3):336–41.

    Article  CAS  PubMed  Google Scholar 

  34. Rahman A, Malik A, Sikander S, Roberts C, Creed F. Cognitive behaviour therapy-based intervention by community health workers for mothers with depression and their infants in rural Pakistan: a cluster-randomised controlled trial. Lancet. 2008;372(9642):902–9.

    Article  PubMed  PubMed Central  Google Scholar 

  35. Patel V, Chowdhary N, Rahman A, Verdeli H. Improving access to psychological treatments: lessons from developing countries. Behav Res Ther. 2011;49(9):523–8.

    Article  PubMed  PubMed Central  Google Scholar 

  36. Kilpela LS, Hill K, Kelly MC, et al. Reducing eating disorder risk factors: a controlled investigation of a blended task-shifting/train-the-trainer approach to dissemination and implementation. Behav Res Ther. 2014;63:70–82.

    Article  PubMed  Google Scholar 

  37. Chacko A, Fabiano F, Doctoroff G, Fortson B. A community parent education program for fathers at risk for child maltreatment. in M. Sibley (chair), Engaging parents as a mechanism of youth behavioral change: Three unique interventions. Symposium presented at the bi-annual meeting of the international society for research on child and adolescent psychopathology. Portland, OR. 2015

  38. Cottingham AH, Alder C, Austrom MG, Johnson CS, Boustani MA, Litzelman DK. New workforce development in dementia care: screening for ‘caring’: preliminary data. J Am Geriatr Soc. 2014;62(7):1364–8.

    Article  PubMed  Google Scholar 

  39. Bloomfield GS, Wang TY, Boulware LE, et al. Review: implementation of management strategies for diabetes and hypertension. From local to global health in cardiovascular diseases. Glob Heart. 2015;10:31–8.

    Article  PubMed  PubMed Central  Google Scholar 

  40. Dawson AJ, Nkowane AM, Whelan A. Approaches to improving the contribution of the nursing and midwifery workforce to increasing universal access to primary health care for vulnerable populations: a systematic review. Hum Resour Health. 2015;13:1–23.

    Article  Google Scholar 

  41. Jayasekera CR, Perumpail RB, Chao DT, et al. Task-shifting: an approach to decentralized hepatitis C treatment in medically underserved areas. Dig Dis Sci. 2015

  42. Maier CB. The role of governance in implementing task-shifting from physicians to nurses in advanced roles in Europe, U.S., Canada, New Zealand and Australia. Health Policy. 2015;119:1627–35.

    Article  PubMed  Google Scholar 

  43. Chacko A, Gopalan G, Franco LM, et al. Multiple family group service model for children with disruptive behavior disorders: child outcomes at post-Treatment. J Emot Behav Disord. 2015;23(2):67–77.

    Article  PubMed  PubMed Central  Google Scholar 

  44. Gopalan G, Fuss A, Wisdom JP. Multiple family groups to reduce child behavior difficulties: influences on retention for child welfare-involved caregivers. Res Soc Work Pract. 2015;25(5):564–77.

    Article  PubMed  Google Scholar 

  45. McKay MM, Gopalan G, Franco L, et al. It takes a village to deliver and test child and family-focused prevention programs and mental health services. Res Soc Work Pract. 2010;20(5):476–82.

    PubMed  PubMed Central  Google Scholar 

  46. McKay MM, Harrison ME, Gonzales J, Kim L, Quintana E. Multiple-family groups for urban children with conduct difficulties and their families. Psychiatr Serv. 2002;53(11):1467–8.

    Article  PubMed  Google Scholar 

  47. McKay MM, Gonzales J, Quintana E, Kim L, Abdul-Adil J. Multiple family groups: an alternative for reducing disruptive behavioral difficulties of urban children. Res Soc Work Pract. 1999;9(5):593–607.

    Article  Google Scholar 

  48. McKay MM, Gonzales JJ, Stone S, Ryland D, Kohner K. Multiple family therapy groups: a responsive intervention model for inner city families. Soc Work Groups. 1995;18(4):41–56.

    Article  Google Scholar 

  49. Wahler RG, Dumas JE. Attentional problems in dysfunctional mother-child interactions: an interbehavioral model. Psychol Bull. 1989;105(1):116–30.

    Article  CAS  PubMed  Google Scholar 

  50. Kazdin AE, Whitley MK. Treatment of parental stress to enhance therapeutic change among children referred for aggressive and antisocial behavior. J Consult Clin Psychol. 2003;71(3):504-515.

  51. Kazdin AE. Conduct disorders in childhood and adolescence. 2nd ed. Thousand Oaks, CA, US: Sage Publications, Inc; 1995.

    Book  Google Scholar 

  52. Fisher PA, Chamberlain P. Multidimensional treatment foster care: a program for intensive parenting, family support, and skill building. J Emot Behav Disord. 2000;8(3):155–64.

    Article  Google Scholar 

  53. Gopalan G, Chacko A, Franco LM, Rotko L, Marcus S, McKay MM. Multiple family groups service delivery model to reduce childhood disruptive behavioral disorders: outcomes at 6-months follow-up. J Child Fam Stud. 2015;24(9):2721–33.

    Article  PubMed  Google Scholar 

  54. McKay MM, Gopalan G, Franco L, et al. A collaboratively designed child mental health service model: multiple family groups for urban children with conduct difficulties. Res Soc Work Pract. 2011;21(6):664–74.

    Article  PubMed  PubMed Central  Google Scholar 

  55. Gopalan G, Bannon WM, Dean-Assael K, et al. Multiple family groups: an engaging mental health intervention for child welfare involved families. Child Welfare. 2011;90(4):135–56.

    PubMed  PubMed Central  Google Scholar 

  56. Gopalan G, Small L, Fuss A, et al. Multiple family groups to reduce child disruptive behavior difficulties: moderating effects of child welfare status on child outcomes. Child Abuse Negl. 2015;46:207–19.

    Article  PubMed  Google Scholar 

  57. Petersen I, Lund C, Bhana A, Flisher AJ. The Mental Health and Poverty Research Programme Consortium. A task shifting approach to primary mental health care for adults in South Africa: human resource requirements and costs for rural settings. Health Policy Plan. 2012;27(1):42–51.

    Article  PubMed  Google Scholar 

  58. DeWalt KM, Dewalt BR. Participant observation: a guide for fieldworkers. Walnut Creek, CA: AltaMira Press; 2002.

    Google Scholar 

  59. Emerson RM, Fretz RI, Shaw LL. Participant observation and fieldnotes. In: Atkinson P, Coffey A, Delamont S, Lofland L, editors. Handbook of ethnography. London: Sage; 2001. p. 352–68.

    Chapter  Google Scholar 

  60. Gopalan G, Franco L, Dean-Assael K, McGuire-Scwartz M, Chacko A, McKay MM. Statewide implementation of the 4Rs and 2Ss for strengthening families. J Evid Based Soc Work. 2014;11:84–96.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Fixsen DL, Naoom SF, Blasé KA, Friedman RM, Wallace F. Implementation research: a synthesis of the literature. Tampa, F.L: University of South Florida, Louis de la Parte Florida Mental Health Institute, The National Implementation Research Network (FMHI Publication #231); 2005.

    Google Scholar 

  62. Beidas RS, Edmunds JM, Marcus SC, Kendall PC. Training and consultation to promote implementation of an empirically supported treatment: a randomized trial. Psychiatr Serv. 2012;63(7):660–5.

    Article  PubMed  PubMed Central  Google Scholar 

  63. Beidas RS, Kendall PC. Training therapists in evidence-based practice: a critical review of studies from a systems-contextual perspective. Clin Psychol Sci Pract. 2010;17(1):1–30.

    Article  Google Scholar 

  64. Stoltenberg CD. Enhancing professional competence through developmental approaches to supervision. Am Psychol. 2005;60(8):857–64.

    Article  PubMed  Google Scholar 

  65. Pelham WE, Evans SW, Gnagy EM, Greenslade KE. Teacher ratings of DSM-III--R symptoms for the disruptive behavior disorders: prevalence, factor analyses, and conditional probabilities in a special education sample. Sch Psychol Rev. 1992;21(2):285–99.

    Google Scholar 

  66. American Psychiatric Association. Diagnostic and statistical manual of mental disorders: DSM-5. Washington, D.C: American Psychiatric Association; 2013.

    Book  Google Scholar 

  67. Pelham WE. ADHD guide. Buffalo, NY: CTAD; 2002.

    Google Scholar 

  68. Lehman WEK, Greener JM, Simpson DD. Assessing organizational readiness for change. J Subst Abuse Treat. 2002;22(4):197–209.

    Article  PubMed  Google Scholar 

  69. Aarons GA. Mental health provider attitudes toward adoption of evidence-based practice: the evidence-based practice attitude scale (EBPAS). Ment Health Serv Res. 2004;6(2):61–74.

    Article  PubMed  PubMed Central  Google Scholar 

  70. Aarons GA, Glisson C, Hoagwood K, Kelleher K, Landsverk J, Cafri G. Psychometric properties and U.S. national norms of the evidence-based practice attitude scale (EBPAS). Psychol Assess. 2010;22(2):356–65.

    Article  PubMed  Google Scholar 

  71. Aarons GA, McDonald EJ, Sheehan AK, Walrath-Greene C. Confirmatory factor analysis of the evidence-based practice attitude scale (EBPAS) in a geographically diverse sample of community mental health providers. Adm Policy Ment Health Ment Health Serv Res. 2007;34(5):465–9.

    Article  Google Scholar 

  72. Aarons GA, Fettes DL, Sommerfeld DH, Palinkas LA. Mixed methods for implementation research: Application to evidence-based practice implementation and staff turnover in community-based organizations providing child welfare services. Child Maltreat. 2012;17(1):67–79.

    Article  PubMed  Google Scholar 

  73. Kitzinger J. Qualitative research: introducing focus groups. British J Med. 1995;311:299–302.

    Article  CAS  Google Scholar 

  74. Morgan DL. Focus groups. Annu Rev Sociol. 1994;22:129–52.

    Article  Google Scholar 

  75. Morgan DL. Focus groups as qualitative research. In: Focus groups as qualitative research. Thousand Oaks. CA, US: Sage Publications, Inc.; 1988.

    Google Scholar 

  76. Morgan DL, Spanish MT. Focus groups: a new tool for qualitative research. Qual Sociol. 1984;7:253–70.

    Article  Google Scholar 

  77. Miles MB, Huberman AM. Qualitative data analysis: an expanded sourcebook. 2nd ed. Thousand Oaks, CA: Sage Publications, Inc.; 1994.

    Google Scholar 

  78. Powell BJ, McMillen JC, Proctor EK, et al. A compilation of strategies for implementing clinical innovations in health and mental health. Med Care Res Rev. 2012;69(2):123–57.

    Article  PubMed  PubMed Central  Google Scholar 

  79. Shaw DS, Vondra JI, Hommerding KD, Keenan K. Chronic family adversity and early child behavior problems: a longitudinal study of low income families. J Child Psychol Psychiatry. 1994;35(6):1109–22.

    Article  CAS  PubMed  Google Scholar 

  80. Egeland B, Kalkoske M, Gottesman N, Erickson MF. Preschool behavior problems: stability and factors accounting for change. J Child Psychol Psychiatry. 1990;31(6):891–909.

    Article  CAS  PubMed  Google Scholar 

  81. Patterson GR, Reid JB, Dishion TJ. A social learning approach: IV. Antisocial boys. Eugene, OR: Castalia; 1992.

    Google Scholar 

  82. Sampson RJ, Laub JH. Urban poverty and the family context of delinquency: a new look at structure and process in a classic study. Child Dev. 1994;65(2):523–40.

    Article  CAS  PubMed  Google Scholar 

  83. Reid JB, Eddy JM, Fetrow RA, Stoolmiller M. Description and immediate impacts of a preventive intervention for conduct problems. Am J Community Psychol. 1999;27(4):483–517.

    Article  CAS  PubMed  Google Scholar 

  84. Alexander JF, Robbins MS, Sexton TL. Family-based interventions with older, at-risk youth: from promise to proof to practice. J Prim Prev. 2000;21(2):185–205.

    Article  Google Scholar 

  85. Kumpfer KL, Alvarado R. Family-strengthening approaches for the prevention of youth problem behaviors. Am Psychol. 2003;58(6–7):457–65.

    Article  PubMed  Google Scholar 

  86. Loeber R, Farrington DP. Serious & violent juvenile offenders: risk factors and successful interventions. Thousand Oaks, CA, US: Sage Publications, Inc; 1998.

    Google Scholar 

  87. Patterson GR, Crosby L, Vuchinich S. Predicting risk for early police arrest. J Quant Criminol. 1992;8(4):335–55.

    Article  Google Scholar 

  88. Keiley MK. The development and implementation of an affect regulation and attachment intervention for incarcerated adolescents and their parents. Fam J. 2002;10(2):177–89.

    Article  Google Scholar 

  89. Jones DJ, Forehand R, Rakow A, Colletti CJM, McKee L, Zalot A. The specificity of maternal parenting behavior and child adjustment difficulties: a study of inner-city African American families. J Fam Psychol. 2008;22(2):181–92.

    Article  PubMed  Google Scholar 

  90. Low SM, Stocker C. ‘Family functioning and children’s adjustment: Associations among parents’ depressed mood, marital hostility, parent-child hostility, and children’s adjustment’: correction to low and stocker (2005). J Fam Psychol. 2012;26(2):253–253.

    Article  Google Scholar 

  91. Gustle L, Hansson K, Sundell K, Lundh L, Löfholm CA. Blueprints in Sweden. Symptom load in Swedish adolescents in studies of functional family therapy (FFT), multisystemic therapy (MST) and multidimensional treatment foster care (MTFC). Nordic J Psychiatry. 2007;61(6):443–51.

    Article  Google Scholar 

  92. Lanza ST, Rhoades BL, Nix RL, Greenberg MT. Conduct Problems Prevention Research Group. Modeling the interplay of multilevel risk factors for future academic and behavior problems: a person-centered approach. Dev Psychopathol. 2010;22(2):313–35.

    Article  PubMed  PubMed Central  Google Scholar 

  93. Montague M, Cavendish W, Enders C, Dietz S. Interpersonal relationships and the development of behavior problems in adolescents in urban schools: a longitudinal study. J Youth Adolescence. 2010;39(6):646–57.

    Article  Google Scholar 

  94. Loeber R, Stouthamer-Loeber M. The prediction of delinquency. In: Quay HC, editor. Handbook of juvenile delinquency. New York: Wiley; 1987. p. 325–416.

    Google Scholar 

  95. Tolan PH, McKay MM. Preventing serious antisocial behavior in inner-city children: an empirically based family intervention program. Fam Relat. 1996;2:148.

    Article  Google Scholar 

Download references

Acknowledgements

Funding for this study was obtained through R21MH102544 (PI: Gopalan). Dr. Gopalan is also an investigator with the Implementation Research Institute (IRI), at the George Warren Brown School of Social Work, Washington University in St. Louis; through an award from the National Institute of Mental Health (R25MH080916-01A2) and the Department of Veterans Affairs, Health Services Research & Development Service, Quality Enhancement Research Initiative (QUERI). The content is solely the responsibility of the author and does not necessarily represent the official views of the National Institute of Mental Health or the National Institutes of Health.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Geetha Gopalan.

Additional information

Competing interests

The author declares that she has no competing interests.

Author’s contribution

GG conceived of the study and drafted the manuscript.

Author’s information

Geetha Gopalan is an Assistant Professor at the University of Maryland School of Social Work, Adjunct Assistant Professor at the New York University School of Medicine Department of Child and Adolescent Psychiatry, Faculty Fellow at the Advanced Center for State Scale-Up for EBPS for Children (IDEAS), and Faculty Fellow at the McSilver Institute for Poverty, Policy, and Research.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gopalan, G. Feasibility of improving child behavioral health using task-shifting to implement the 4Rs and 2Ss program for strengthening families in child welfare. Pilot Feasibility Stud 2, 21 (2016). https://doi.org/10.1186/s40814-016-0062-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40814-016-0062-2

Keywords