Table 1 Assessment measures across participants and time points
Construct | Measure | Brief description | Time points | Participants | Method/procedure |
|---|---|---|---|---|---|
Proposed mechanisms of change | |||||
Knowledge | Test of knowledge | 39-items developed to assess advocates knowledge of screening, barriers, engagement strategies, and trauma; mixed format of multiple choice and true/false | Pre-training, post-training, follow-up | Victim Advocate | Self-Report via REDCap |
Self-evaluation of knowledge | 20-item measure assessing self-perceived knowledge of evidence-based treatment, mental health, screening, trauma, and engagement strategies | Pre-training, post-training, follow-up | Victim Advocate | Self-Report via REDCap | |
Skills | Fidelity | Items developed for respondents to rate use of engagement skills during a meeting with caregiver | Pre-training, post-training, follow-up | Victim Advocate | Self-Report via REDCap |
Potential moderators | |||||
Attitudes | Victim Advocate Attitudes | 22-items developed to assess respondents’ attitudes towards mental health, screening, trauma, and supervision | Pre-training, post-training, follow-up | Victim Advocate | Self-Report via REDCap |
Barriers to treatment | Perceived barriers to treatment | Advocates perceptions of barriers families face when attempting to access evidence-based mental health services | Pre-training, post-training, follow-up | Victim Advocate | Self-Report via REDCap |
Ethnic Sensitivity | Ethnic sensitivity inventory: precontact [48] | 5-items assessing respondent’s sensitivity to other cultures and ethnicities | Pre-training, post-training, follow-up | Victim Advocate | Self-Report via REDCap |
Organizational support | Perceived organizational support [49] | 16 items assessing respondents’ perceptions of the support they receive from their agency | Pre-training, post-training, follow-up | Victim Advocate | Self-Report via REDCap |
Supervisory support | Perceived supervisory support [50] | 16 items assessing respondents’ perceptions of the support they receive from their supervisor | Pre-training, post-training, follow-up | Victim Advocate | Self-Report via REDCap |
Self-Efficacy | General self-efficacy [51] | 8-item measure assessing belief in one’s capability to meet task demands across contexts (i.e., self-efficacy) | Pre-training, post-training | Victim Advocate | Self-Report via REDCap |
Executive functioning | Behavior Rating Inventory of Executive Function-Adult [52] | Assessment of executive functioning abilities (abbreviated version) | Pre-training | Victim Advocate | Self-Report via REDCap |
Learning anxiety | Learner Anxiety Assessment | 3-item measure assessing concerns regarding learning new information | Pre-training | Victim Advocate | Self-Report via REDCap |
Motivation to learn | 3 items assessing trait-like motivation to learn new things | Pre-training | Victim Advocate | Self-Report via REDCap | |
5-items assessing motivation to learn information specific to the E3 training | Pre-training | Victim Advocate | Self-Report via REDCap | ||
Training evaluation | |||||
Webinar evaluation | Post-webinar evaluation | Brief measure assessing satisfaction with each webinar and feedback regarding potential improvements | Completed after each webinar | Victim Advocate | Self-Report via REDCap |
Overall training evaluation | Post-training evaluation | Measure assessing overall satisfaction with, acceptability of, and feedback regarding E3 training, including webinars, consult calls (when applicable), and related assignments | Post-training | Victim Advocate | Self-Report via REDCap |
Senior Leader | |||||
Participant and agency characteristics | |||||
Demographics | Demographic Questionnaire | Basic demographic information | Pre-training, post-training, follow-up | Victim Advocate | Self-Report via REDCap |
Senior Leader | |||||
CAC agency level | Agency Level Questionnaire | Information specific to the CAC, including annual numbers of forensic interviews, funding structure, etc. | Pre-training, post-training, follow-up | Senior Leader | Self-Report via REDCap |
NCA Census | Survey completed by CACs every other year assessing funding sources, staffing information, and detailed information on mental health services provided by CACs and partner agencies | 2020 | Senior Leader | NCA Census Survey (Qualtrics) | |
Multidisciplinary team | OMS MDT Biannual Survey | Anonymous, voluntary survey completed by members of the MDT regarding the functioning of MDT, feedback on the process, and suggestions for improving the MDT | Twice yearly survey | MDT members | OMS MDT Survey |
Outcomes | |||||
CAC Outcome data | Child Contact Data | Basic demographic information about the child, details regarding who met with the family, what was provided during the visit, and whether the family was (1) referred to and (2) subsequently attended a mental health appointment. | Pre-training, post-training, follow-up | Victim Advocate | REDCap |
OMS Initial Caregiver Survey | Anonymous, voluntary survey typically collected on-site at the end of the CAC visit via paper surveys or electronically; obtains family feedback regarding their visit and the support and follow-up provided by CAC staff | Throughout the year, as per CAC protocol | Caregiver report | OMS Initial Caregiver Survey | |
OMS Follow-up Caregiver Survey | Anonymous, voluntary survey typically completed via a phone call 4 to 8 weeks post-visit; collects additional feedback regarding on-site visit, support, and subsequent follow-up by CAC and MDT staff | Throughout the year, as per CAC protocol | Caregiver report | OMS Follow-up Caregiver Survey | |
Screening | |||||
Mental health screening | Child Behavioral Health Screener | Pediatric Symptom Checklist (PSC-17 [55];) plus 3 items focused on clinical-level child trauma symptoms, 6 items assessing functional impairment, and 3 critical items assessing suicidality, problematic sexual behavior, and substance use. | Pre-training, post-training, follow-up | Caregiver report (total score) | REDCap |