Skip to main content

Table 3 Assessment of interrater reliability per checklist item

From: Developing an implementation fidelity checklist for a vocational rehabilitation intervention

Stage

Item

Component description

Core or desirable

Cohen’s Kappa

95% CIs

1. Early recovery

1.1

OT intervenes within 12 weeks of stroke.

Core

1

1

1.2

OT assesses the impact of the stroke on the participant.

Core

a

1.3

OT assesses the impact of the stroke on the participant’s job.

Core

a

1.4

OT assesses the impact of the stroke on the participant’s family.

Desirable

0.79

0.56–0.89

1.5

OT helps participant plan a return to work and prepares them to return to work.

Core

1

1

1.6

OT communicates in writing with relevant stakeholders regarding work status.

Core

a

1.7

OT coordinates VR across relevant sectors.

Core

0.74

0.44–0.87

2. Graded return to work

2.1

OT provides education and advice to the participant.

Core

1

1

2.2

OT provides emotional support to the participant.

Desirable

0.83

0.73–1.0

2.3

OT provides education and advice to the employer.

Core

0.82

0.61–1.0

2.4

OT provides emotional support to the employer.

Desirable

0.76

0.73–1.0

2.5

OT provides education and advice to the participant’s family.

Desirable

0.79

0.69–1.0

2.6

OT provides emotional support to the participant’s family.

Desirable

0.79

0.69–0.88

2.7

OT negotiates a phased return to work.

Core

1

1

2.8

OT mediates workplace adjustments.

Core

1

1

2.9

OT provides a mechanism for feedback based on work performance.

Core

0.79

0.66–0.89

2.10

OT continuously monitors the participant’s return to work to ensure sustainability and job retention.

Core

1

1

3. Job retention

3.1

OT identifies issues that arise within the return-to-work process with relevant stakeholders.

Core

0.75

0.58–0.89

3.2

OT addresses issues that arise within the return-to-work process with all stakeholders.

Core

0.69

0.61–0.78

3.3

OT explores alternative duties and/or job roles with the participant where current work could not be sustained/ was not feasible.

Core

0.76

0.63–1.0

3.4

OT practices gradual, appropriate disengagement from intervention with the participant.

Core

1

1

3.5

OT discusses gradual, appropriate disengagement from intervention with the participant’s employer.

Core

0.79

0.48–0.89

4. Discharge

4.1

OT and participant agree on an appropriate timepoint for withdrawing from intervention.

Core

0.81

0.69–1.0

4.2

OT discusses and communicates mechanisms for re-accessing vocational services or provides information about access to further avenues of support to the participant.

Core

0.87

0.62–1.0

4.3

OT discusses and communicates mechanisms for re-accessing vocational services or provides information about access to further avenues of support to the participant’s employer.

Core

0.9

0.79–1.0

4.4

OT discusses and communicates mechanisms for re-accessing vocational services or provides information about access to further avenues of support to the participant’s family.

Desirable

0.77

0.55–0.89

4.5

OT provides the participant’s GP and other relevant health care professionals with a copy of the discharge letter.

Core

1

1

  1. aBoth researchers rated this item as having sufficient evidence in every case. The lack of variation in scoring made it impossible to calculate a Cohen’s kappa