Implementation resources to support teachers’ use of behavioral classroom interventions: protocol of a randomized pilot trial
Pilot and Feasibility Studies volume 9, Article number: 151 (2023)
Teacher-delivered behavioral classroom management interventions are effective for students with or at-risk for attention-deficit/hyperactivity disorder (ADHD) or other disruptive behavior challenges, but they can be difficult for teachers to use in the classroom. In this study, we will pilot test a package of implementation strategies to support teachers in using behavioral classroom interventions for students with ADHD symptoms.
We will use a 2-group, randomized controlled trial to compare outcomes for teachers who receive Positive Behavior Management Implementation Resources (PBMIR), a theory and data-driven implementation resource package designed to increase teacher implementation of behavioral classroom management interventions, with those who do not receive this additional implementation support. We will measure teacher implementation outcomes (e.g., observed fidelity to behavioral classroom interventions) and student clinical outcomes (e.g., ADHD-related impairment, ADHD symptoms, student–teacher relationship, academic performance) before and after an 8-week intervention period for both groups; we will also measure teacher-reported acceptability, appropriateness, and feasibility for the PBMIR group following the intervention period.
If there is preliminary evidence of feasibility and effectiveness, this pilot study will provide the foundation for evaluation the PBMIR at a larger scale and the potential to improve outcomes for students with or at risk for ADHD.
This clinical trial was registered at ClinicalTrials.gov. (https://clinicaltrials.gov/) on 8/5/2022 which was prior to the time of first participant enrollment. The registration number is: NCT05489081.
Behavioral classroom management interventions, delivered by teachers in classrooms, show evidence for improving student behavioral and academic engagement outcomes . Evidence-based classroom management interventions emphasize both antecedent- and positive consequence-based approaches to manage student classroom behavior, and are consistent with schoolwide frameworks such as Positive Behavior Interventions and Supports (PBIS; [32, 33]. They can be delivered to all students in the class (i.e., universal or Tier 1 practices), as well as with students who need additional support (i.e., targeted or Tier 2 interventions). These interventions are important for supporting children with or at-risk for attention-deficit/hyperactivity disorder (ADHD), for whom they show strong evidence of success [9, 10]. However, teachers often do not use Tier 1 and Tier 2 behavioral classroom interventions as designed, if they use them at all [14, 23, 28]. This suggests a need for implementation strategies to support teachers in using these interventions. Implementation strategies are most likely to be effective when they are theory driven and target specific, malleable factors that influence provider behavior .
Behavioral classroom management interventions encompass a wide range of practices, which can vary along several dimensions, including whether they are designed to be applied to the entire class (i.e., Tier 1), or to targeted students only (i.e., Tier 2); whether they use antecedents, consequences, or both; and the time and effort they require to implement. Evidence suggests that teachers use some specific interventions more than others  and our prior work indicates that teachers’ intentions to use behavioral classroom interventions vary by specific intervention . Our prior work also found that teacher-reported barriers and facilitators to using behavioral interventions differ between Tier 1 and Tier 2 interventions . Together, this suggests that implementation strategies to support teachers in using behavioral classroom interventions should be tailored to specific intervention components.
The Theory of Planned Behavior  may be useful for developing implementation strategies because it delineates two sets of factors that may influence teachers’ implementation: factors that promote their intentions to implement an intervention and factors that promote their ability to act on strong intentions . It also delineates specific psychological determinants of intentions: attitudes (e.g., whether a teacher “likes” or “dislikes” behavioral classroom management strategies for ADHD), social norms (e.g., whether the teacher perceives that other teachers use behavioral classroom management strategies or whether their supervisor expects them to use them), and self-efficacy (e.g., whether teachers believe that they have the necessary skills to successfully implement behavioral classroom management practices). These determinants provide potential mechanisms for increasing implementation among teachers who report low intentions to use a behavioral intervention . At the same time, for teachers who do not implement a behavioral intervention despite positive intentions to do so, implementation strategies should target teachers’ ability to act on their intentions . Theories of habit formation , which propose that automatic behavior is triggered by situational or contextual cues, suggest specific strategies, such as reminders in the environment, to use when intentions are strong but not acted upon. For example, if a teacher is ambivalent about using a behavioral classroom intervention, they may benefit from messages targeting attitudes or norms (e.g., narrative from other teachers about how they have found it helpful). On the other hand, if a teacher intends to use the intervention but struggles to actually do so within a busy classroom environment, they may benefit from reminders or strengthening habits.
Our team developed an implementation resource package (“Positive Behavior Management Implementation Resources, PBMIR”) to support teachers in using Tier 1 and Tier 2 behavioral classroom interventions, particularly with students with elevated levels of hyperactivity, inattention or impulsivity. The resource package is informed by the Theory of Planned Behavior  and theories of habit formation , to target attitudes, norms, self-efficacy, habits, and reminders; it specifically targets barriers and facilitators identified by teachers as important in a previous study . It uses a modular format to support teachers in using four key behavioral classroom management interventions: behavior-specific praise (i.e., providing frequent verbal acknowledgment by specifically labeling praise-worthy behavior; e.g., , precorrections (i.e., reminding students about behavioral norms prior to a time when behaviors of concern might be likely; e.g., ; brief and specific behavior corrections (i.e., consistently correcting behavior in a clear, concise and calm way; e.g., ; and use of daily behavior reports to provide feedback on specific behavioral goals (e.g., . The PBMIR also includes two additional modules to support factors that were identified as critical for implementation of the target interventions: student–teacher relationships and adult wellness.
We developed the PBMIR through an iterative, community-partnered process, in which we made revisions based on feedback obtained from teachers during a series of try-outs of versions of the PBMIR; we interpreted try-out data and made revisions in partnership with a Program Development Team of stakeholders (e.g., teachers, coaches, administrators). We designed this resource package to fit within existing school structures, align with school-wide Positive Behavior Interventions and Supports (PBIS), and be feasible to sustain with existing resources. If effective, deploying this resource package as an implementation strategy at scale may help address the critical need of supporting teachers in using evidence-based behavioral classroom interventions. An important first step, though, is to conduct a pilot study testing the feasibility, acceptability, and preliminary effectiveness of the PBMIR.
The main objective of this study is to pilot test the implementation strategy resource package. We will evaluate the teacher-reported feasibility, acceptability and appropriateness of the resource package. We will also collect data on teacher implementation outcomes and child effectiveness outcomes to examine the promise of the resource package.
Setting and sample
The study will be conducted in elementary or elementary-middle schools from a large urban school district in the Northeast United States. The district’s student body is racially and ethnically diverse (about 50% Black/African American, 21% Hispanic/Latino, 14% Non-Hispanic White, 7% Asian, and 5% Multiracial or Other races). Approximately 80% of these students live in households that are income-eligible for free or reduced-price meals. We will recruit schools that have already adopted schoolwide Positive Behavioral Interventions and Supports (PBIS) and will obtain written permission from principals for their schools’ participation, following school district processes.
Our target sample size is 30 teachers (teaching grades Kindergarten through 5th grade; with students of ages approximately 5 through 12) within participating schools over a two-year period. Teachers will nominate students in their classroom to participate (see “Procedures” section). We will enroll 2 students per teacher, for a target sample size of 60 students. These sample sizes were selected to be consistent with guidelines for pilot studies to determine the feasibility of recruiting participants, collecting outcome data, and retaining participants in the protocol .
Recruitment and informed consent
All procedures are approved by the institutional research board at the Children’s Hospital of Philadelphia and the research review committee of the participating school district. Any protocol amendments will be reviewed and approved by the IRB and school district review board prior to any changes taking place, and ClinicalTrials.gov will be updated to reflect any relevant changes.
Teachers will be recruited from participating schools. See Table 1 for the schedule of enrollment, interventions, randomization, and data collection. After providing informed consent for their participation, teachers will nominate two students from their classroom to participate. Teachers will be instructed to nominate students who “show elevated levels of inattentive, hyperactive or impulsive behaviors;” whom “you think may benefit from increased use of positive behavior management practices,” and “for whom you could use additional support in managing their behaviors.” Teachers will complete the Impairment Rating Scale (IRS; , a 7-point scale ranging from 0 to 6, for each of these students, without providing identifying information about the student. To meet inclusion criteria, a student must receive a score of 3 or greater on at least one IRS domain. If one or more of the nominated students does not meet this criterion, the teacher will nominate an additional student until two students are identified who meet this criterion. Students will be excluded from participation if they have a special education classification of intellectual disability, if their primary presenting concern is psychosis or autism spectrum disorder based on parent- or teacher- report, or if they present as in acute risk of harm to self or others, such that participation would be clinically inappropriate because they warrant more intensive intervention.
For each student who meets criteria, teachers will be asked to contact the student’s parent/legal guardian to obtain verbal permission for the research team to contact them, and for the teacher to provide the research team with their contact information. If a student’s parent/legal guardian declines permission or cannot be reached, the teacher will nominate an additional student and will complete an IRS screening form regarding the student. If it is not possible to identify two children within a classroom who meet screening criteria and for whom informed consent can be obtained, we will allow the teacher to participate with one enrolled child.
After permission from the parent/legal guardian is obtained, the teacher will provide the research team with the student’s name, parent’s name, contact information, and preferred method of contact. The research team will reach out to the parent/legal guardian and obtain their informed consent for the student’s participation.
Teachers will be randomized to condition blocked on grade level (i.e., grades K-2 vs. 3–5) and school. The principal investigator will generate the allocation sequence using online software (Sealed Envelope Ltd., 2022.) Students will be assigned to their teachers’ condition. A member of the research team will notify teachers of their assigned condition after baseline data collection is complete. If they are assigned to the “PBMIR” condition, the research team will schedule a meeting with them the week following randomization to provide them with a copy of the PBMIR, and the 8-week time period will start at that meeting. If they are assigned to the “Implementation Support as Usual” condition, the 8-week time period will start the following week, in order to ensure the timelines are comparable between conditions. Teachers in the “Implementation Support as Usual” condition will be permitted to receive any implementation support that they would otherwise receive related to classroom management (which could include trainings or instructional coaching), and this support will be documented via teacher report at endpoint. Teachers in this condition will receive a copy of the PBMIR electronic, written, and tangible resources following post- data collection to thank them for their participation. Children in both conditions will continue to receive any therapy or medication that they would otherwise receive during the study period, and parents will be asked to report about any medication their child takes at baseline and endpoint.
Positive Behavior Management Implementation Resources
The Positive Behavior Management Implementation Resources (PBMIR), previously developed using an iterative, community-partnered process, is organized into six modules: (1) student–teacher relationships; (2) adult wellness; (3) behavior-specific praise; (4) precorrections; (5) calm behavior-specific corrections; and (6) daily behavior reports.
Teachers will engage with the resource package for a period of 8 weeks. Each teacher is assigned a guide, who consults with the teacher during four, brief (i.e., 15–20 min) meetings during this period to support their engagement. The guide assists the teacher with goal setting, identifying relevant resources, building motivation, problem solving, and reflecting on progress. The guide supports the teacher in selecting modules to work on, working within a consistent structure: first focusing on student–teacher relationships (either class-wide or with the specific focal student), then focusing on behavior-specific praise, then proceeding to either precorrections or calmly-delivered behavior-specific corrections, and moving on to daily behavior reports last. Adult wellness resources for teachers are used if and when relevant.
Guides are supported by a written manual that consists of four sections: (1) an introduction with an overview, guiding beliefs (e.g., teachers are experts in their classrooms and their professional practice), and policies (e.g., confidentiality, scheduling); (2) an overview of the Theory of Planned Behavior; (3) process strategies (i.e., rapport building, motivational interviewing, goal setting, problem solving), and session agendas (i.e., a broad outline for the first session, follow-up sessions, and final session). Individuals serving in the guide role should be familiar with the elementary school classroom context, child development, and core behavioral principles, but guides do not need to have a specific educational background.
In addition to guide meetings, the resource package includes the following components: (1) written one-page documents (e.g., overview, tip sheet with messages targeting attitudes, norms, and strategies to use reminders, document with sentence stems to provide sample language); (2) fillable planning guides; (3) optional text message reminders, for which teachers can select the frequency and time to receive them; (4) the option to follow an ‘Instagram’ account with reminder posts and tips; (5) videos about the target practices, including teacher testimonials; (6) a notepad to use for self-monitoring; and (7) tangible resources and reminders, including stickers and sticky notes. Teachers set their goals and choose the resources to use in collaboration with their guide.
Feasibility of research procedures
We will track the number of teachers and students enrolled in the study. We will also examine the proportion of nominated and eligible students for whom informed consent is obtained.
We will calculate the proportion of parent- and teacher- report surveys completed at each time point out of the number of teachers and students enrolled and randomized across conditions.
We will record the number of teachers and students who withdraw from the study and will compute the retention rate for each group of participants (i.e., teachers, students) as the proportion of participants who do not withdraw out of the number of enrolled and randomized teachers and children across conditions.
Engagement with the resource package
We will track teachers’ use of specific aspects of the resource package by tracking: 1) the number of guide meetings attended by each teacher in the PBMIR condition; 2) the percentage of teachers in the PBMIR condition who agree to receive text message reminders; and 3) the percentage of teachers in the PBMIR condition who choose to follow the Instagram account.
Teacher implementation outcomes
Teachers in the resource package condition will complete the Acceptability of Intervention Measure (AIM; , which consists of four items (e.g., “[Intervention] is appealing to me”) on a 5-point Likert scale, regarding the resource package. Teachers will complete this measure at the end point, following their 8-week participation period. This measure has shown acceptable reliability (alpha \(\ge\) 0.83) and test–retest reliability (Pearson correlations above 0.70) in prior samples.
Teachers will complete the Intervention Appropriateness Measure (IAM; , which consists of four items (e.g., “[Intervention] seems suitable”) on a 5-point Likert scale, regarding the resource package. Teachers will complete this measure at the end point. This measure has shown acceptable reliability (alpha \(\ge\) 0.87) and test–retest reliability (Pearson correlations above 0.70) in prior samples.
Teachers will complete the Feasibility of Intervention Measure (FIM; , which consists of four items (e.g., [Intervention] seems easy to use”) on a 5-point Likert scale, regarding the four target interventions supported by the resource package. Teachers will complete this measure at the end point. This measure has shown acceptable reliability (alpha \(\ge\) 0.88) and test–retest reliability (Pearson correlations above 0.70) in prior samples.
A member of the study team will conduct classroom observations at the baseline, midpoint and end point of study participation for teachers in both conditions. These observations will use a modified version of the Student Behavior Teacher Response (SBTR) scale . Observers will record counts of focal student norm violations and teacher responses to norm violations (i.e., no response, inappropriate response, appropriate response). Observers will also record counts of teacher use of behavior-specific praise, unlabeled praise, precorrections (directed at the focal students and overall), and teacher behaviors related to using daily behavior reports for focal students. We will observe these practices at both the universal and targeted levels because three of the target practices can be employed class-wide. Finally, the observer will rate the teachers’ global competence regarding classroom management and supportive relationships (with the whole class and with each target student) on a 7-point scale (from “poor” to “excellent”) following each observation. Approximately 20% of observations will be conducted by two observers so that inter-observer agreement can be calculated.
Student–teacher relationship scale
Teachers will complete the Student–Teacher Relationship Scale  about participating children at the baseline and the end point. This scale assesses teachers’ perceptions of their relationship with individual students. The STRS has shown adequate test–retest reliability (r = 0.89) and good internal consistency (α = 0.89; . It generates three subscales (conflicts, closeness, dependency) and an overall total score. The total score will be used as a secondary outcome measure.
ADHD symptoms and impairment
Teachers and parents will complete the NICHQ Vanderbilt Scale  about participating children at the baseline and the end point. The inattention and hyperactivity/impulsivity scales on the Vanderbilt have high internal consistency, acceptable test–retest reliability, and convergent validity . Teacher-report and parent-report on items related to adaptive functioning (e.g., “disrupting class,” “relationship with peers”) will be used as a primary outcome measure, and teacher-reported and parent-reported inattention and hyperactivity/impulsivity symptoms will be used as secondary outcome measures.
Academic performance rating scale
Teachers will complete the Academic Performance Rating Scale  about participating children at the baseline and the end point. This scale assesses teacher judgment of students’ academic functioning across two subscales: Academic Success (i.e., academic achievement) and Academic Productivity (i.e., day-to-day performance). The subscales are each measured by 8 items, rated on 5-point scales. They have acceptable internal consistency (0.72–0.95), stability (0.88–0.95), criterion-related validity, and sensitivity to intervention [12, 24]. Teacher-reported Academic Productivity will be used as a primary outcome measure and teacher-reported Academic Success will be used as a secondary outcome measure.
Direct behavior rating multi-item scales (DBR-MIS)
Teachers will complete ratings of child behavior using Direct Behavior Rating Multi-Item Scales (DBR-MIS; see . For this study, teachers will rate behaviors in two domains: Engagement (5 items rating frequency of these behaviors on a 7-point scale ranging from Never to Almost Always) and Disruptive Behavior (5 items rating degree to which each item is a problem on a 7-point scale ranging from Not a Problem to Serious Problem). These domains of the DBR-MIS have demonstrated treatment sensitivity . Teachers will complete these ratings at baseline, midpoint and endpoint. The average rating within domains will be used as secondary outcome measures.
Homework Performance questionnaire–parent form (HPQ-P)
Parents will complete the Homework Performance Questionnaire-Parent Form  at baseline and endpoint. Parents will complete this measure for target students in grades 1–5. The student self-regulation factor, which has shown strong internal consistency (i.e., alpha's between 0.92 and 0.94;  will be used as a secondary outcome measure.
Teacher intentions questionnaire
Teacher intentions to implement each of the four intervention components will be measured using a standardized 4-item questionnaire . The items will use validated stems designed to probe provider intentions to use a specific practice (e.g., “I intend to…”), measured on a 7-point scale from “Strongly disagree” to “Strongly agree.” Teachers will be asked to complete these items “regarding students in your class who show elevated levels of inattentive, impulsive, or hyperactive behaviors.” Additionally, teachers will be asked to complete these items regarding participating children after the children have enrolled in the study.
Teacher determinants of intentions questionnaire
Teachers will complete a questionnaire with validated, standardized item stems (Fishbein and Ajzen, 2010) to report on their attitudes, norms, and self-efficacy for using behavioral classroom management interventions “regarding students in your class who show elevated levels of inattentive, impulsive, or hyperactive behaviors.”
Teacher self-rated habit index (SRHI)
Teachers will complete the SRHI, a 12-item scale that assesses the automaticity of a behavior, as well as its frequency of repetition and assimilation into one’s self-identity, regarding their use of behavior-specific praise at baseline and end point . The SRHI has shown high internal consistency (i.e., alpha’s between 0.85 and 0.95) and convergent validity (i.e., correlation of r = 0.58 with response-frequency measure; .
Barriers and facilitators questionnaire
Teachers will report on the extent to which each of 10 potential barriers (five classified as beliefs that weaken intentions, and five classified as challenges that interfere with execution) and 12 facilitators (three classified as beliefs that strengthen intentions, seven classified as factors that assist with executing, and two classified as factors that assist with learning how to use the practice) impact their use of behavior-specific praise at baseline and endpoint. We developed these items from qualitative interview data from teachers in an earlier study .
The primary goals of the analyses are to examine the feasibility and preliminary effectiveness of the PBMIR package. We will examine the recruitment rate, response rate, retention rate to assess the feasibility of the research procedures, inform adjustments to procedures as necessary, and inform sample size estimates in a larger trial as indicated. Consistent with recommendations  we will use traffic light criteria to determine whether the research protocol should proceed to a full trial unchanged (“green”), with adaptations (“amber”), or not at all (“red”). The specific criteria are listed in Table 2.
We use descriptive statistics to examine teacher-reported acceptability, appropriateness, and feasibility of the implementation resource package. We then will conduct independent sample t tests to examine whether the intervention and control groups differ on baseline teacher and student outcomes.
To compare teacher use of the four behavioral classroom interventions between the implementation strategy and control group, we will estimate means, standard deviations (SD), and 95% confidence intervals (CI) of observed teacher use of the four interventions and teacher global competence ratings. Similarly, to compare child-level outcomes between the groups, we will estimate means, SDs, and 95% CI of child primary and secondary outcomes. We will examine baseline and post-intervention scores, as well as change scores. We will compute effect sizes for each outcome measure by calculating the difference in change scores for the implementation strategy versus control group between post intervention and baseline and dividing this amount by the pooled standard deviation of the change score for implementation strategy and control .
Although the study is not powered for significance testing, we will conduct exploratory analyses examining between-group differences. We will use multi-level linear models, implemented in HLM software, to account for the nested data structure (i.e., students nested within teachers, nested within schools). We also will examine change in the measure of teacher intentions and teacher-reported implementation barriers, and explore with regression analyses the extent to which these variables have the potential to mediate the effect of intervention on outcomes, consistent with the conceptual model for mediation . These analyses will determine whether there is preliminary evidence to support changes in intentions and specific barriers as plausible mechanisms for the implementation strategy.
The goal of this pilot study is to examine the feasibility and promise of the package of PBMIR, designed to help teachers strengthen student–teacher relationships and implement evidence-based behavioral classroom interventions, particularly for students with or at-risk for ADHD. If the pilot study results indicate that the PBMIR is acceptable, feasible and promising, this pilot study will provide the foundation for evaluating the PBMIR at a larger scale. Therefore, this research has the potential to ultimately lead to improved teacher effectiveness and student outcomes. Because the research is being conducted in a large, urban school district that serves a predominantly marginalized and minoritized student body, and the PBMIR is designed to be appropriate, feasible, and sustainable to implement in this context, it also may be appropriate for other large, urban school districts. Given that children spend much of their time in the classroom setting, improving the implementation of evidence-based practices for children with or at-risk for ADHD in this context offers considerable promise for improving population-level mental health and promoting health equity.
There are several notable strengths to this project. The PBMIR were developed through an iterative, community-partnered process, which is key to ensuring contextual appropriateness and feasibility [5, 18]. The implementation resource supports target practices that align with school-wide PBIS as implemented in the school district and uses terminology consistent with school and district initiatives. The PBMIR is informed by theory by targeting key constructs that shape individual’s intentions (i.e., attitudes, norms, self-efficacy) and their ability to act on intentions (i.e., habits, reminders); it was also informed by prior quantitative and qualitative data from teachers [20, 21]). The theory-driven, data-driven, and community-partnered foundational work for this study improves the likelihood that the PBMIR will be effective, acceptable, contextually appropriate, and feasible. We will collect data regarding both teacher implementation outcomes and student outcomes, using multiple methods (rating scale, direct observations) and informants (i.e., parent report, teacher report). Finally, we anticipate that the study will generate knowledge about potential mechanisms for implementation strategies (e.g., habits) that may generalize beyond the context of behavioral classroom interventions in schools.
We acknowledge several potential limitations, as well as potential practical or operational issues. First, the study is designed as a pilot study to establish feasibility and promise of the PBMIR and to lay the foundation for a larger scale trial; it is not powered for significance testing. Because of this goal, we are collecting data on a large number of outcome measures, and therefore may be at risk for type I and type II errors. Second, there are considerable challenges to participant recruitment, retention, and the implementation of research procedures in historically under-resourced schools. Many of these challenges have been heightened during the COVID-19 pandemic. We therefore anticipate challenges with recruitment and data collection, and are planning approaches to minimize burden, promote engagement using incentives ethically, and ensure alignment with school and district priorities. We also note that we do not plan to collect child-report outcome measures, which could add valuable information. Finally, we acknowledge that the PBMIR is designed as an individual, teacher-level implementation strategy, and does not target important school-level factors such as leadership and climate. School-level variability in these organizational factors may be important for the implementation and outcomes of the PBMIR, but the current study is not designed to examine these relationships, given the relatively small number of included schools.
If the pilot study results support the resource packages’ promise, the next step in this program of research would be to evaluate the PBMIR at a larger scale through an adequately-powered, randomized hybrid trial (i.e., a trial measuring both implementation outcomes and effectiveness outcomes simultaneously, see . This would enable us to more definitively assess the PBMIR’s effectiveness regarding teacher implementation outcomes and student outcomes. Moreover, a larger scale trial would also support the examination of individual and organizational factors that serve as mediators and moderators of implementation outcomes.
Availability of data and materials
De-identified data will be available upon request from the corresponding author.
Positive Behavior Interventions and Supports
Positive Behavior Management Implementation Resources
Student Behavior Teacher Response
Ajzen I. The theory of planned behavior. Organ Behav Hum Decis Process. 1991;50(2):179–211.
Avery, K. N. L., Williamson, P. R., Gamble, C., O’Connell Francischetto, E., Metcalfe, C., Davidson, P., Williams, H., & Blazeby, J. M. (2017). Informing efficient randomised controlled trials: exploration of challenges in developing progression criteria for internal pilot studies. BMJ Open, 7(2), e013537. https://doi.org/10.1136/bmjopen-2016-013537.
Bard DE, Wolraich ML, Neas B, Doffing M, Beck L. The Psychometric properties of the Vanderbilt Attention-Deficit Hyperactivity Disorder Diagnostic Parent Rating Scale in a community population. J Dev Behav Pediatr. 2013;34(2):72–82. https://doi.org/10.1097/DBP.0b013e31827a3a22.
Collier-Meek, M. A., Johnson, A. H., Sanetti, L. H., & Minami, T. (2019). Identifying critical components of classroom management implementation. School Psychology Review, 48(4), 348–361. https://doi.org/10.17105/SPR-2018-0026.V48-4.
Concannon TW, Fuster M, Saunders T, Patel K, Wong JB, Leslie LK, Lau J. A systematic review of stakeholder engagement in comparative effectiveness and patient-centered outcomes research. J Gen Intern Med. 2014;29(12):1692–701. https://doi.org/10.1007/s11606-014-2878-x.
Cook CR, Grady EA, Long AC, Renshaw T, Codding RS, Fiat A, Larson M. Evaluating the impact of increasing general education teachers’ ratio of positive-to-negative interactions on students’ classroom behavior. J Posit Behav Interv. 2017;19(2):67–77. https://doi.org/10.1177/1098300716679137.
De Pry RL, Sugai G. The effect of active supervision and pre-correction on minor behavioral incidents in a sixth grade general education classroom. J Behav Educ. 2002;11(4):255–67.
DuPaul GJ, Rapport MD, Perriello LM. Teacher ratings of academic skills: The development of the Academic Performance Rating Scale. Sch Psychol Rev. 1991;20(2):284–300. https://doi.org/10.1080/02796015.1991.12085552.
Evans SW, Owens JS, Wymbs BT, Ray AR. Evidence-based psychosocial treatments for children and adolescents with Attention Deficit/Hyperactivity Disorder. J Clin Child Adolesc Psychol. 2018;47(2):157–98. https://doi.org/10.1080/15374416.2017.1390757.
Fabiano GA, Pelham WE, Coles EK, Gnagy EM, Chronis-Tuscano A, O’Connor BC. A meta-analysis of behavioral treatments for attention-deficit/hyperactivity disorder. Clin Psychol Rev. 2009;29(2):129–40. https://doi.org/10.1016/j.cpr.2008.11.001.
Fabiano GA, Pelham WE, Waschbusch DA, Gnagy EM, Lahey BB, Chronis AM, Onyango AN, Kipp H, Lopez-Williams A, Burrows-MacLean L. A practical measure of impairment: Psychometric properties of the impairment rating scale in samples of children with attention deficit hyperactivity disorder and two school-based samples. J Clin Child Adolesc Psychol. 2006;35(3):369–85.
Fabiano GA, Vujnovic RK, Pelham WE, Waschbusch DA, Massetti GM, Pariseau ME, Naylor J, Yu J, Robins M, Carnefix T. Enhancing the effectiveness of special education programming for children with attention deficit hyperactivity disorder using a daily report card. Sch Psychol Rev. 2010;39(2):219.
Fishman J, Beidas R, Reisinger E, Mandell DS. The utility of measuring intentions to use best practices: a longitudinal study among teachers supporting students with autism. J Sch Health. 2018;88(5):388–95. https://doi.org/10.1111/josh.12618.
Hart KC, Fabiano GA, Evans SW, Manos MJ, Hannah JN, Vujnovic RK. Elementary and middle school teachers’ self-reported use of positive behavioral supports for children With ADHD: A national survey. J Emot Behav Disord. 2017;25(4):246–56. https://doi.org/10.1177/1063426616681980.
Hayes AF, Rockwood NJ. Regression-based statistical mediation and moderation analysis in clinical research: observations, recommendations, and implementation. Behav Res Ther. 2017;98:39–57. https://doi.org/10.1016/j.brat.2016.11.001.
Holdaway AS, Hustus CL, Owens JS, Evans SW, Coles EK, Egan TE, Himawan L, Zoromski AK, Dawson AE, Mixon CS. Incremental benefits of a Daily Report Card over time for youth with disruptive behavior: Replication and extension. Sch Ment Heal. 2020;12(3):507–22. https://doi.org/10.1007/s12310-020-09375-w.
Hustus CL, Owens JS, Volpe RJ, Briesch AM, Daniels B. Treatment sensitivity of Direct Behavior Rating–Multi-Item Scales in the context of a Daily Report Card intervention. J Emot Behav Disord. 2020;28(1):29–42. https://doi.org/10.1177/1063426618806281.
Israel BA, Schulz AJ, Parker EA, Becker AB. Community-based participatory research: Policy recommendations for promoting a partnership approach in health research. Educ Health. 2001;14(2):182–97. https://doi.org/10.1080/13576280110051055.
Landes, S. J., McBain, S. A., & Curran, G. M. (2019). An introduction to effectiveness-implementation hybrid designs. Psychiatry Research, 280, 112513. https://doi.org/10.1016/j.psychres.2019.112513.
Lawson, G. M., Owens, J. S., Mandell, D. S., Tavlin, S., Rufe, S., & Power, T. J. (2023). Exploring teachers’ intentions to use behavioral classroom interventions. Evidence-Based Practice in Child and Adolescent Mental Health, 1–9. https://doi.org/10.1080/23794925.2023.2183434.
Lawson GM, Owens JS, Mandell DS, Tavlin S, Rufe S, So A, Power TJ. Barriers and facilitators to teachers’ use of behavioral classroom interventions. Sch Ment Heal. 2022;14(4):844–62. https://doi.org/10.1007/s12310-022-09524-3.
Lewis, C. C., Klasnja, P., Powell, B. J., Lyon, A. R., Tuzzio, L., Jones, S., Walsh-Bailey, C., & Weiner, B. (2018). From classification to causality: advancing understanding of mechanisms of change in Implementation Science. Frontiers in Public Health, 6. https://doi.org/10.3389/fpubh.2018.00136.
Martinussen R, Tannock R, Chaban P. Teachers’ reported use of instructional and behavior management practices for students with behavior problems: Relationship to role and level of training in ADHD. Child Youth Care Forum. 2011;40(3):193–210. https://doi.org/10.1007/s10566-010-9130-6.
Murray DW, Rabiner D, Schulte A, Newitt K. Feasibility and integrity of a parent–teacher consultation intervention for ADHD students. Child Youth Care Forum. 2008;37(3):111–26. https://doi.org/10.1007/s10566-008-9054-6.
Nilsen, P., Roback, K., Broström, A., & Ellström, P.-E. (2012). Creatures of habit: accounting for the role of habit in implementation research on clinical behaviour change. Implementation Science, 7(1). https://doi.org/10.1186/1748-5908-7-53.
Odgaard EC, Fowler RL. Confidence intervals for effect sizes: compliance and clinical significance in the Journal of Consulting and Clinical Psychology. J Consult Clin Psychol. 2010;78(3):287–97. https://doi.org/10.1037/a0019294.
Owens JS, Coles EK, Evans SW, Himawan LK, Girio-Herrera E, Holdaway AS, Zoromski AK, Schamberg T, Schulte AC. Using multi-component consultation to increase the integrity with which teachers implement behavioral classroom interventions: a pilot study. Sch Ment Heal. 2017;9(3):218–34. https://doi.org/10.1007/s12310-017-9217-4.
Owens JS, Evans SW, Coles EK, Holdaway AS, Himawan LK, Mixon CS, Egan TE. Consultation for classroom management and targeted interventions: Examining benchmarks for teacher practices that produce desired change in student behavior. J Emot Behav Disord. 2020;28(1):52–64. https://doi.org/10.1177/1063426618795440.
Pianta RC. Student-Teacher Relationship Scale. Psychological Assessment Resources: Professional Manual; 2001.
Power TJ, Watkins MW, Mautone JA, Walcott CM, Coutts MJ, Sheridan SM. Examining the validity of the Homework Performance Questionnaire: multi-informant assessment in elementary and middle school. Sch Psychol Q. 2015;30(2):260–75. https://doi.org/10.1037/spq0000081.
Sheeran P. Intention—behavior relations: a conceptual and empirical review. Eur Rev Soc Psychol. 2002;12(1):1–36. https://doi.org/10.1080/14792772143000003.
Simonsen B, Sugai G. School-wide positive behavioral interventions and supports: a systems-level application of behavioral principles. In: Little SG, Akin-Little A, editors. Behavioral interventions in schools: Evidence-based positive strategies. American Psychological Association; 2019. https://psycnet.apa.org/record/2019-11201-001.
Staff AI, van den Hoofdakker BJ, van der Oord S, Hornstra R, Hoekstra PJ, Twisk JWR, Oosterlaan J, Luman M. Effectiveness of specific techniques in behavioral teacher training for childhood ADHD: a randomized controlled microtrial. J Clin Child Adolesc Psychol. 2021;50(6):763–79. https://doi.org/10.1080/15374416.2020.1846542.
Teresi JA, Yu X, Stewart AL, Hays RD. Guidelines for designing and evaluating feasibility pilot studies. Med Care. 2022;60(1):95–103. https://doi.org/10.1097/MLR.0000000000001664.
Verplanken B, Orbell S. Reflections on past behavior: a self-report index of habit strength. J Appl Soc Psychol. 2003;33(6):1313–30.
Volpe RJ, Briesch AM. Generalizability and dependability of single-item and multiple-item Direct Behavior Rating Scales for engagement and disruptive behavior. Sch Psychol Rev. 2012;41(3):246–61. https://doi.org/10.1080/02796015.2012.12087506.
Weiner, B. J., Lewis, C. C., Stanick, C., Powell, B. J., Dorsey, C. N., Clary, A. S., Boynton, M. H., & Halko, H. (2017). Psychometric assessment of three newly developed implementation outcome measures. Implementation Science, 12(1). https://doi.org/10.1186/s13012-017-0635-3.
Wolraich ML. Psychometric properties of the Vanderbilt ADHD Diagnostic Parent Rating Scale in a referred population. J Pediatr Psychol. 2003;28(8):559–68. https://doi.org/10.1093/jpepsy/jsg046.
The development of the PBMIR was a collaborative effort between the study team and many other partners. We gratefully acknowledge the teachers who participated in try-outs and provided feedback, and partners at the PBIS office of the partnering school district. We also acknowledge the Program Development Team, which included TiQuann Jett-Jamison, Alexandra Smink, Aubrey Depa, Hasana Ahmad, Anne McKendry, Brianna Heflin, Adell Shaw, Rashida Alexander, and the rest of the Program Development Team. Finally, Rebecca Dolfman, Devon Linn, and Burrell Smithen contributed to this work.
This research is supported by K23MH122577.
Ethics approval and consent to participate
This study was approved by the Children’s Hospital of Philadelphia Institutional Review Board under protocol number 22–019825 It was also approved by the school district research review committee. We will obtain written teacher consent, using a paper or online consent form, prior to participation in the study. We will obtain written or verbal consent from parents/legal guardians for their child’s participation. Children who are age 12 or older, or who will turn 12 during the course of study participation, will provide assent for participation. Data will be stored on REDCap. Copies of only coded data (i.e., with participant unique study ID, questionnaire responses,) will be downloaded from the REDCap for data analysis purposes. These data will be stored in password-protected files on the Principal Investigator’s office computer, in a secure server for research.
Consent for publication
Steven Rufe receives consulting fees from the Children’s Hospital of Philadelphia and Drexel University. All other authors declare they have no competing interests to report.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Lawson, G.M., Owens, J.S., Mandell, D.S. et al. Implementation resources to support teachers’ use of behavioral classroom interventions: protocol of a randomized pilot trial. Pilot Feasibility Stud 9, 151 (2023). https://doi.org/10.1186/s40814-023-01381-4