Dimension | Quantitative measures | Â | Â | |||
---|---|---|---|---|---|---|
Index | Data | Data quality | Difficulty of collection | Missing data | Key feasibility index | |
Reach (Did we reach the target audience?) | Participating learners (%)^ | 92/109 = 84% | +++ | + | Rarely | Yes |
Effectiveness (Individual level outcomes resulting from the program.) | Change in providers’ knowledge scores (post − pre = difference, %) | 52% − 6% = 46% | ++ | ++ | Rarely | - |
Change in providers’ skills scores (post − pre = difference, %) | 39% − 12% = 27% | ++ | ++ | Rarely | - | |
Change in providers’ self-efficacy ratings (post − pre = difference, %) | 42% − 21% = 21% | + | ++ | Rarely | - | |
Improved quality noted in 5 item core bundle of care (%)$ | 3/5 = 60% | + | +++ | Often | Yes | |
Clinically improved patients’ shock indices (%) | 38% − 28% = 10% | + | +++ | Occasional | - | |
Learner evaluations with satisfaction score ≥ 7 out of 10 (%) | 485/526 = 92% | +++ | ++ | Rarely | Yes | |
Facilitator evaluations with mean satisfaction scores ≥ 7 out of 10 | 145/156 = 93% | +++ | ++ | Rarely | Yes | |
Adoption (Indications that stakeholders and users within the institution will adopt this program.) | Participating facilitators (%) | 10/12 = 83% | +++ | + | Rarely | Yes |
Facilitators surveyed who would participate again (%) | 5/6 = 83% | ++ | + | None | Yes | |
EMS leaders surveyed responding HEET is a good fit for WCG EMS (%) | 8/8 = 100% | +++ | + | None | Yes | |
Implementation fidelity (Did we implement the program as we intended?) | Proportion of content delivered as originally planned (%)* | 90% | ++ | + | None | Yes |
Number of training modules delivered as originally planned (%)* | 6/8 = 75% | ++ | + | Rarely | Yes | |
Proportion of trainings starting with 15 min of intended (%) | 127/164 = 77% | ++ | + | Occasionally | Yes | |
Proportion of sessions (trainings & evals) lasting 15 min or less (%) | 131/164 = 80% | ++ | + | Occasionally | Yes | |
Average of key implementation feasibility indices (SD)= | 83% (SD = 10.3) | Â | Â | Â | ||
Average of all RE-AIM implementation indices (SD) = | 68% (SD = 27.7) | Â | Â | Â |