A mixed-methods feasibility study of a new digital health support package for people after stroke: the Recovery-focused Community support to Avoid readmissions and improve Participation after Stroke (ReCAPS) intervention
Pilot and Feasibility Studies volume 8, Article number: 241 (2022)
Evidence for digital health programmes to support people living with stroke is growing. We assessed the feasibility of a protocol and procedures for the Recovery-focused Community support to Avoid readmissions and improve Participation after Stroke (ReCAPS) trial.
We conducted a mixed-method feasibility study. Participants with acute stroke were recruited from three hospitals (Melbourne, Australia). Eligibility: Adults with stroke discharged from hospital to home within 10 days, modified Rankin Score 0–4 and prior use of Short Message System (SMS)/email. While in hospital, recruited participants contributed to structured person-centred goal setting and completed baseline surveys including self-management skills and health-related quality of life. Participants were randomised 7–14 days after discharge via REDCap® (1:1 allocation). Following randomisation, the intervention group received a 12-week programme of personalised electronic support messages (average 66 messages sent by SMS or email) aligned with their goals. The control group received six electronic administrative messages. Feasibility outcomes included the following: number of patients screened and recruited, study retainment, completion of outcome measures and acceptability of the ReCAPS intervention and trial procedures (e.g. participant satisfaction survey, clinician interviews). Protocol fidelity outcomes included number of goals developed (and quality), electronic messages delivered, stop messages received and engagement with messages. We undertook inductive thematic analysis of interview/open-text survey data and descriptive analysis of closed survey questions.
Between November 2018 and October 2019, 312 patients were screened; 37/105 (35%) eligible patients provided consent (mean age 61 years; 32% female); 33 were randomised (17 to intervention). Overall, 29 (88%) participants completed the12-week outcome assessments with 12 (41%) completed assessments in the allocated timeframe and 16 also completing the satisfaction survey (intervention=10). Overall, trial participants felt that the study was worthwhile and most would recommend it to others. Six clinicians participated in one of three focus group interviews; while they reported that the trial and the process of goal setting were acceptable, they raised concerns regarding the additional time required to personalise goals.
The study protocol and procedures were feasible with acceptable retention of participants. Consent and goal personalisation procedures should be centralised for the phase III trial to reduce the burden on hospital clinicians.
Australian New Zealand Clinical Trials Registry, ACTRN12618001468213 (date 31/08/2018); Universal Trial Number: U1111-1206-7237
Key messages regarding feasibility
We identify potential benefits, feasibility (inclusive of time-commitment) and acceptability of a new digital health, post-hospital discharge support package (ReCAPS intervention) designed for use after an acute stroke.
Our training procedures, standard operating manuals goal-setting procedures and use of a REDCap® database accessible via a study iPad supported implementation of our protocol, including consent and baseline data collection, by clinicians within the acute care setting.
Use of feedback from three complementary sources (participant satisfaction surveys; clinician focus groups; communications with research staff) contributed to the redesign of our ReCAPS package for a definitive randomised controlled trial.
Stroke is a leading cause of global disease burden . The immediate and long-term consequences of stroke make it challenging for individuals to return to the community and participate in life activities . Adjustments such as learning new behaviours or modifying one’s lifestyle are essential for reducing the risk of future cardiovascular events and supporting recovery, but uptake is poor . The ease with which adjustments occur is multifaceted and relies, in part, on a person’s self-efficacy including beliefs about their capabilities in performing various everyday activities . There is evidence that self-management programmes targeted at self-efficacy improve outcomes such as quality of life and physical function and enhance resilience after stroke . The field of digital health has grown over recent years, in particular with telemedicine services or digital applications . However, it remains unclear whether there is a role for electronic communication delivered in the community for long-term self-management and recovery after a new stroke.
To maximise the effectiveness of self-management strategies and to ensure buy-in from the individual, effort must be made to actively involve the person with stroke in determining goals that are important to them . Goal attainment is also enhanced when support is provided to individuals to achieve their goals [7, 8], but this is difficult outside healthcare settings. Now that use of mobile phones and personal computers is extensive , novel digital support programmes that incorporate electronic communication via Short Message Service (SMS) or email may provide the necessary support relating to life after stroke outside healthcare settings . The use of Internet-based programmes [11,12,13] and electronic communications such as SMS or email [14,15,16,17] have gained momentum for addressing secondary prevention of cardiovascular diseases (CVD) in recent years. However, the evidence for digital health programmes that are based on tailored electronic communication to address secondary prevention and recovery after stroke, a disease which tends to occur at older ages than CVD, remains limited.
We aimed to test the feasibility and safety of the Recovery-focused Community support to Avoid readmissions and improve Participation after Stroke (ReCAPS) phase II study. The ReCAPS intervention is a tailored digital health self-management post-hospital discharge support package provided for secondary prevention and recovery after stroke. Specifically, this phase II study was initiated to assess the completion of study procedures and feasibility of recruitment and test randomisation processes. We also sought to review and explore the acceptability of the ReCAPS intervention package and options for goal setting, and the potential barriers to recruitment, consent processes and associated training needs as perceived by clinicians working at participating hospitals.
This was a mixed-methods feasibility trial initiated within three public hospitals (Melbourne, Australia). Feasibility of the trial design and procedures was obtained and summarised from the data collected using screening logs, completion of data report forms and the completion of study procedures. As recommended by Thabane et al. , we also obtained qualitative data to supplement the quantitative information. The qualitative component included conducting focus group interviews with clinicians from participating hospitals, communications with research staff and analysis of the open text fields from satisfaction surveys administered to participants on study completion.
Clinicians from stroke units obtained informed consent from eligible patients willing to participate. The inclusion and exclusion criteria are described in Table 1.
Clinician training and other study procedures for the ReCAPS trial
All hospital clinicians and outcome assessors involved in screening, recruitment of patients and outcome assessments completed training sessions with the project manager and trial coordinator. The training included an overview of the study, procedural aspects for screening, recruitment, data capture using a REDCap®  (Research Electronic Data Capture) database accessible via a study iPAD and interviewing techniques. To promote the self-selection of health and recovery goals that were meaningful to the participant, all hospital clinicians received training in using the standardised menu-driven goal-setting package from researchers who had developed this [21, 22]. The package supported the setting of person-centred goals according to the SMART (Specific, Measurable, Achievable, Realistic, Timely) criteria [23, 24] to support reliable measurement of attainment using Goal Attainment Scaling (GAS) . As part of the goal-setting training, research clinicians were asked to encourage participants to write down their goals in the educational booklet My Stroke Journey, to share with family and health professionals. The My Stroke Journey booklet is provided at discharge in Australia as part of routine care (https://strokefoundation.org.au/what-we-do/for-health-professionals/hospital-resources/my-stroke-journey).
For each clinician, the goals developed with their first five participants were externally rated for quality using the Smart Goal Evaluation Method (Smart-GEM) , by an independent clinical expert. The SMART-GEM scoring system rates each goal according to the extent set goals meet the SMART criteria, with a scoring range of zero (poor quality) to six (good quality) . The SMART-GEM was used as an audit and training tool to ensure standardisation for developing person-centred goals in accordance with all the SMART metrics. If the SMART-GEM score for the participant was less than four, the clinician who developed the goals was given feedback and provided with additional training if required.
Clinical outcomes collected at baseline and 12 weeks post-randomisation included GAS ; self-management skills (Health Education Impact Questionnaire (heiQ)  and the Stroke Self-Efficacy Questionnaire (SSEQ)) ; disability assessed by the modified Rankin Score(mRS) ; mood (Hospital Anxiety and Depression Scale (HADS)) ; health-related quality of life (EQ-5D-3L) ; and longer-term problems affecting physical, social and mental well-being after stroke (Longer-term Unmet Needs Scale (LUNS)) . A study-specific questionnaire on use of healthcare resources and costs was also administered. In preparation for the outcome assessment, the clinical outcome measures were posted to participants 2–3 weeks prior to the due date of their assessment. A blinded outcome assessor contacted participants by telephone 12 weeks post-randomisation, within a window of 14 days. At the end of the outcome assessment, the participant was asked whether they were willing to complete a satisfaction survey, which was either posted or emailed to those who agreed.
The satisfaction survey included open-text and closed questions and had previously been tested . Questions provided the opportunity for participants to share perceived benefits of the programme, willingness to continue with the programme or likelihood of recommending it to other survivors of stroke. Participants in the intervention group were asked additional questions about the type and frequency of electronic messages, appropriateness of message content and perceptions about the adequacy of the length of support in the study.
All clinicians involved in the hospital-based procedures for ReCAPS were invited to participate in a focus group discussion. Focus groups with clinicians were conducted by one researcher who had clinical care and qualitative research expertise. Interviews were conducted face-to-face (x1), via video conference (x1) and via video conference plus telephone (x1). Interviews began with a discussion about the aims of the study and explored views and experiences of the clinicians on the acceptability of the ReCAPS trial protocol, including inclusion criteria, processes for recruitment, outcome assessment and goal-setting. Potential difficulties experienced with implementation or adherence to the protocol and staff training needs were also explored. Discussions were recorded and transcribed verbatim with anonymity of the respondents preserved. Iterative feedback was obtained throughout the trial from the research staff, including trial coordinator, trainers and outcome assessors. Feedback was recorded in study meeting minutes, and adjustments made to process documents were documented.
A randomisation schedule was developed centrally through the REDCap® system by a researcher not involved in the recruitment of participants. The ReCAPS REDCap® database  was set to generate the random sequence (1:1 allocation) and stratify by age (<65 or ≥65 years) and level of disability according to the mRS [none-slight (score 0–2), moderate-severe (score 3–4)] . Once the baseline assessment had been completed, participants were contacted between 7 and 14 days from date of hospital discharge by researchers not involved in hospital care or recruitment. At this contact, the researchers reconfirmed the willingness to participate in ReCAPS and performed the randomisation procedures. Allocation was concealed to ensure recruiters, participants, outcome assessors and the study data analyst would be unaware of group allocation (see Fig. 1).
Recruitment of participants commenced on 28 November 2018 with the final participant recruited on 2 October 2019 (47 weeks). To ensure blinding of participants, the study was described in terms of ‘providing discharge support after hospital’ without explicit details of the differing components of the intervention and control groups.
Both intervention and control groups received the same procedures before randomisation and since this differs from usual care, the control is considered an ‘active’ control. Briefly, the pre-randomisation procedures included the setting of person-centred goals using a 34-item menu to guide the conversation with the participants about choosing between three and five meaningful goals they would like to work on after leaving hospital. All participants were encouraged to select at least one goal related to secondary prevention from the Health goal domain. The Health goal domain covers nine secondary prevention areas such as quitting smoking and controlling blood pressure. To promote a standardised and measurable approach to goal setting, clinicians were encouraged to refer to the manual to help guide them in the process of developing SMART goals with participants. The manual included a summary of best clinical practice recommendations for each goal , the goal metrics and worked examples of goals illustrating conformity with the SMART metrics [21, 22]. A summary sheet of the completed goals was then provided to the participant so that these could be shared with family and other health professionals after discharge.
The specific procedures provided to the intervention and control groups following randomisation are outlined in Table 2. The digital health support package is the complete set of components delivered to the intervention group. Following randomisation, we used the iVERVE (Inspiring Virtual Enabled Resources following Vascular Events) platform of >1200 support electronic messages that incorporates a delivery system for tailoring messages to an individual’s goals, as well as delivery of administrative messages . Through the iVERVE platform, the Monash researcher programmed the delivery of electronic messages to commence within 3–4 days of randomisation that continued over 12 weeks. The electronic messages allow two-way communication so that participants could reply to messages, or use “STOP” if they no longer wished to receive them. Both the intervention and active control groups received six electronic administrative messages over the 12 weeks and the intervention group got additional messages specific to supporting achievement of their specified goals.
Feasibility study outcomes
Assessment of feasibility and the criteria for determining the success of feasibility (in brackets) included:
Estimating the rates of screening and enrolment by hospital clinicians, determined as the proportion of patients admitted with acute stroke who were screened for study eligibility and enrolled (>30% meeting study eligibility are consented)
Estimating the rates of retention, measured as the proportion of randomised participants who completed their 12-week outcome assessment within the allocated timeframe (12 weeks post-randomisation + 14 days) (>70% completion of outcome assessment)
Ascertaining completeness of health measures and goal-setting procedures (>90% completeness)
Acceptability of the intervention and trial procedures, as measured by a satisfaction survey administered to participants after completion of their final assessment (>80% satisfaction with goal setting processes), and positive feedback from clinician interviews and researcher communications regarding the completion of study processes and time commitment
Safety, determined by the number of reported serious adverse events (falls or car accidents requiring medical attention, or presentations to hospital) related to the intervention (no serious adverse event related to the intervention).
Intervention fidelity was measured by assessing:
The number and type of secondary prevention and recovery goals developed by participants (2–5 person-centred goals set by each participant using the goal-setting menu)
The quality of goals developed by clinicians (SMART-GEM score >4)
The number of electronic messages successfully sent (no delivery failures)
The number of ‘Stop’ messages received from participants (<5% request ‘STOP’ to receiving all messages)
The participants’ engagement with messages (>30% access hyperlinks)
Sample size rationale
A predefined sample size is not required for a feasibility trial and most will use a pragmatic sample of 12 or more per group, if the sample is representative of the target study [18, 33]. We used a pragmatic sample size of approximately 30 randomised patient participants to evaluate the feasibility of study procedures and protocol.
Descriptive statistics were reported for the participants’ characteristics, retention and completion of outcome measures by group allocation (intervention or control). Open-ended responses from the satisfaction surveys, and interview transcripts from the focus groups, were analysed using a qualitative content analysis approach ; closed questions were summarised descriptively. Methods of constant comparison were used to explore the intervention-context fit and draw together meaning from the data .
Feasibility of screening, enrolment and retention
A total of 312 patients admitted with acute stroke were screened for study eligibility and 34% (n = 105) met the study inclusion criteria (Fig. 1). Consent was provided by 37 (35%) individuals of which 34 (92%) were randomised. There was an observed recruitment rate of 2.8 participants per month per hospital. At the 7–14-day follow-up call, 17 were randomised to the intervention and 16 to control. Reasons for non-eligibility at randomisation (n = 4) comprised inability to complete the baseline assessment (n = 1), inability to locate the participant (n = 1) and a surgical intervention that led to prolonged hospitalisation (n = 2). Twenty-nine participants (88%) completed their outcome assessment (intervention n = 15; active control n = 14). The outcome assessments were completed a median of 104 (range 90 to 154) days from randomisation. One outlier who was difficult to contact had their data collected 154 days post-randomisation. Less than 1% of data were missing at baseline and outcome assessments.
Characteristics of participants
Participant baseline characteristics are presented in Table 3 with the groups appearing to be well-balanced. Twenty-two participants indicated that email was their preferred method for receiving electronic messages, and all participants indicated a preference for follow-up assessments by telephone call, rather than video-conference call.
Feasibility—outcome assessment completeness
The 12-week outcome assessments with participants were completed in one telephone session and took between 60 and 90 min. Some participants reported completing mailed copies of the questionnaires (sent to support telephone completion) but did not return them as there was no return envelope. This highlighted the need for study procedures to be revised to enable self-completion as an option. Revised study processes were introduced in April 2019 to facilitate the self-completion of surveys (return by post or electronically). The assessors subsequently reported the remaining assessments taking between 30 and 45 min to complete for those who had completed their surveys prior (electronic or returned paper forms).
Overall, 29 (88%) participants completed the 12-week outcome assessments. However, there were challenges in meeting the outcome assessment timeframe whereby only 12/29 (41%) were conducted in accordance with study protocol (week 12 post-randomisation +14 days). Outcome assessors identified a need to improve participant tracking of follow-up visits to meet protocol requirements. Recommended improvements included setting up reminder notifications in REDCap® to be sent to the outcome assessor and project coordinator for when participants’ assessments were due. The tracking database was improved to record the outcome assessor allocated for the call, the participants’ preferred contact days/times and recording of notes relating to attempted contact calls.
Feasibility assessment—participant acceptability of the intervention
Sixteen participants (48%; 10 intervention: 59%; 6 control: 38%) provided feedback via the satisfaction survey. Most respondents (n = 14, >80%) reported that the goal-setting menu was useful to develop person-centred goals, and the clinicians were helpful during this process. Participants were satisfied with the domains categorised on the goal-setting menu and did not provide suggestions for modification. Most participants (n = 14, >80%; intervention n = 9, control n = 8) agreed that it was worthwhile taking part in the study and they would recommend it to others with stroke. Twelve participants responded to the item about the content of the project, and 58% (intervention n = 4, control n = 4) agreed that they found it relevant to them. Most participants (n = 13, >80%; intervention n = 8, control n = 5) agreed that they trusted the information provided (Fig. 2).
All respondents from the intervention group agreed that they led the process of selecting their own goals. Ninety percent reported that the messages received improved their knowledge of stroke and they were comfortable accessing and responding to the messages (via mobile phone or computer). Most respondents (70%) from the intervention group reported the frequency of the electronic messages received suited them and the 12-week period to receive them was sufficient for their needs. One participant reported a reduced length of time would have been sufficient, and one participant felt the messages should be sent over 24 weeks.
Among intervention participants, most of the respondents (>70%) reported the electronic messages helped to increase self-management, in adopting healthy lifestyle behaviours and in working towards achieving goals. One participant reported they had not received any messages from the ReCAPS team. Five responders (50%) in the intervention group reported not accessing web links for additional information from the messages they received as they did not understand how to access the link, or did not notice the weblinks. All responders in the intervention group reported increased confidence in using electronic devices since being involved in the study.
Feasibility assessment—clinician feedback
Characteristics of clinicians
Six hospital clinicians participated in one of three focus groups (with at least one from each participating hospital): two identified as nurse practitioners, one as a physiotherapist, one as an occupational therapist and two as trial nurses. Clinician participants were all involved in the clinical care of adults after stroke. Most (four of the six) reported prior experience with setting person-centred goals. However, the degree of experience varied between clinicians, with two having held responsibility for leading interdisciplinary goal-setting within stroke rehabilitation teams, while others had only contributed to such teams, or had no prior experience.
Hospital clinician feedback on study processes
Clinicians reported several barriers to recruitment, including competing clinical demands, other trials vying for participants and time constraints for completing person-centred goal setting with participants before discharge. Clinicians new to clinical trials highlighted being unsure of how to approach potential participants and provide “the right amount of information” about the trial without “overburdening” them (Physiotherapist, female, Hospital 2). Clinicians were responsible for a full clinical caseload in addition to being responsible for study recruitment, limiting their availability to screen and recruit. As highlighted by one clinician: “And I guess what I know is that my role is centrally around acute stroke management so, code stroke calls. This means that there are days where I'm just completely unable to even screen.” (Nurse practitioner, female, Hospital 1).
The inclusion criteria (discharge to home) created a time pressure for recruitment, as discharge destination was not always clear at the time of admission, and the time window for recruitment was often limited by short lengths of stay.
Yeah, it’s, it’s, as I say, it’s always towards discharge, it’s always sort of towards the end of the admission. And it’s typically that I’m providing information and consenting on the same day. (Trial nurse, female, Hospital 1)
It’s a tricky thing with these sort of discharge support type trials, isn’t it because it’s not like a drug trial where you find them on admission, and you’ve got a whole kind of length of time to get through everything you’ve got to. (Occupational Therapist, female, Hospital 2)
Hospital clinicians also reported that baseline measurements were completed over several sessions, due to the time required to complete, and competing clinical demands. Many clinicians left the assessments with the participant for self-completion.
I am always on the lookout for patients who I think are going to be able to be very independent in filling out their questionnaires, because for me being, unfortunately, a slave to the stroke pager means that there are times where I’m just gonna have to go and interrupt our interview... It [the questionnaire] takes quite a long time. And if I can leave it with a patient, great. And usually I'll leave that with them for a few hours. (Nurse practitioner, female, Hospital 1)
Nurses, in particular, reported a lack of confidence in developing person-centred goals while for other health disciplines (physiotherapists or occupational therapists), setting person-centred goals was considered to be consistent with their usual practice. One nurse clinician felt that they had developed new skills during the trial and continued to implement this type of goal setting with all patients at discharge. The tension between spending the required time with the participant for person-centred goal setting whilst meeting health service needs and routine discharge timelines was raised by at least one clinician across each participating hospital, highlighting a universal theme of time constraint in acute hospitalisation.
Five participants (three in the intervention group) reported seven adverse events at the 90-day outcome assessment, all of which were unrelated to the intervention. These included a medication side effect, presentations to the emergency department (n = 5) and one planned hospital admission for vascular surgery.
Among the 33 participants, a total of 131 person-centred goals were developed across the five major domains. The proportion of participants who selected goals within each of the major goal domains were similar between the intervention and control groups (Table 4). In total, 63 (47%) person-centred goals were developed from the Health domain (e.g. secondary prevention) with the most frequently associated with exercising (n = 13), losing weight (n = 12) and management of blood pressure (n = 10). Overall, return to driving was the goal most frequently selected by participants (n = 17, 52%).
Quality assessment of SMART goals developed by hospital clinicians
The person-centred goals developed by hospital clinicians were independently assessed as varying in quality, with SMART-GEM scores ranging from two (poor quality), to six out of six (median score 5.3, Q1 4.6; Q3 5.65). One clinician had quality scores below the SMART-GEM threshold of four; this occurred with four of the eleven goals developed with three participants.
The time taken to set up the messaging schedule for participants in the intervention group took between 50 and 60 min at the start of the trial. This did decrease over time to between 35 and 45 min, with the development of a messaging schedule template according to the number of goals developed.
Participants in the intervention group were sent a total of 1115 messages (average 66 per participant, standard deviation [SD] 10) compared with 101 messages sent to the control group (average 6 per participant, SD 1). There was one occurrence of all scheduled messages failing to be delivered on one day. The issue was rectified within 24 h with the scheduled messages sent. Two participants in the intervention group sent a ‘stop’ message: participant 1 after receiving 41 of 63 messages, finding them “annoying”; participant 2 after receiving 74 of 76 scheduled messages, and who indicated a particular goal had been achieved. Among the 303 messages sent to participants with an embedded bit.ly hyperlink to additional support resources, the hyperlinks were accessed 109 times (36%). The most frequently accessed hyperlink was the Stroke Foundation Enable Me website (44 times, 40%). Eight messages were received from participants in response to questions such as “would you like to speak with someone for further information?”, or “confirm, by reply SMS or email, that you have received our messages?”.
We successfully delivered a post-hospital discharge support package involving person-centred goal setting and electronic messages among 33 individuals. We provide insights into the feasibility, acceptability and fidelity of the study protocol and procedures necessary to refine the study design for a future phase III effectiveness trial. Collecting feedback using the satisfaction survey with participants, focus group interviews with clinicians and meeting minutes from research staff enabled the exploration of the views of all individuals involved in the study. The ReCAPS post-hospital discharge support package was implemented with excellent adherence and <1% missing data suggesting the protocol was well-defined. Qualitative findings provided insights into the acceptability of ReCAPS by exploring the views of clinicians at the three hospitals. Focus groups with hospital clinicians revealed concerns about the time taken to develop person-centred goals prior to discharge, and it is plausible that this tension may have influenced the quality of the goals set. However, all clinicians viewed setting person-centred goals as a key component of the ReCAPS intervention.
Recruitment of participants by hospital clinicians is likely to be supported in a phase III trial, particularly if the length of time to complete the baseline assessment in hospital is reduced. Based on the findings from this feasibility study, it would be expected that with 16 hospitals each recruiting one participant a week, the required sample size of 890 participants for a phase III trial could be obtained within 56 weeks. A feasibility assessment checklist has been implemented to ensure that clinicians who express an interest in collaborating with ReCAPS have the capacity to enrol at least one eligible participant per week and understand the overall recruitment target.
Major learning points
Synthesising the results identified areas in which study processes could be improved for the implementation of the phase III trial.
Hospital clinicians report the recruitment processes to be daunting
Less experienced hospital clinicians valued the training and support provided for recruitment. A peer video featuring advice from a successfully recruiting clinician has been recorded to support multimodal training for future purposes. A study brochure and infographic were developed and implemented to further assist clinicians in explaining the trial to potential participants.
Setting person-centred SMART goals takes time and experience
The feasibility evaluation highlighted that setting person-centred goals with participants as part of usual discharge care varied across clinical staff, and participating clinicians reported not always feeling comfortable with the task. This may have been explained by the fact that many of our clinicians were nurses and, unlike allied health professionals, had reported formalised goal-setting processes were not part of their usual practice.
The Trial Executive Committee determined that in the phase III trial, clinicians would use the goal-setting menu to assist participants identify their personal health and recovery goals at baseline. At the 7–14-day post-discharge telephone call, the project coordinator/manager will be responsible for assisting the participant to convert the selected goals into a SMART statement. The person-centred SMART goals developed would continue to be independently audited for quality using the SMART-GEM tool to ensure consistency throughout the trial.
Electronic messages were acceptable and relevant
The satisfaction expressed by participants with respect to content, trustworthiness and delivery (frequency and duration) suggests that no changes to the delivery of the ReCAPS support package were required. However, as only half of the intervention participants used the embedded weblinks, the phase III ReCAPS trial includes an explanation to participants at the randomisation call about the potential usefulness of embedded weblinks and how to access them. Participants in the intervention group also receive an electronic message with instructions about using weblinks. In the phase III trial, engagement with electronic messages will be measured by capturing the number of times embedded weblinks are accessed and the number of messages received from participants.
Establishing the connection
One participant reported they had not received any messages from the ReCAPS team. Improved administrative processes have been established for the phase III study, so all participants are advised when to expect their first electronic message and reminded to check junk mail if not received. Participants in the intervention group also receive a message asking to confirm the receipt of the first ReCAPS message.
Variability in time to collect 90-day outcomes
Improved tracking of outcome assessments due and automated reminder notifications to the outcome assessors via REDCap® have been implemented in the phase III trial. To improve completion of outcome measures and the satisfaction survey, the option for self-completion via REDCap® was established.
This feasibility study has confirmed the importance of the trial as perceived by participants, and the fidelity with study processes and procedures. The high fidelity of the delivery of the protocol led the Investigator group to confidently progress to the phase III trial with refinements introduced using the evidence from this study. Consequently, amendments to the protocol for the transition to a phase III trial were submitted and approved . The phase III trial is a prospective, parallel two-group, double-blind (hospital staff, patients and outcome assessors), multi-site, individual-randomised controlled trial with intention-to-treat analysis. The objective is to test the potential effectiveness, including cost-effectiveness, of the comprehensive electronic self-management support programme provided for 12 weeks after hospital discharge on emergency department presentations or unplanned hospital readmissions and to improve patient self-efficacy over 90 days using a randomised controlled trial design. Feedback from process evaluation will help to understand the acceptability and feasibility of the study intervention and procedures from the perspective of participants, clinicians and researchers who participated in the trial. To ensure the sample size is attained (n = 890), it is extended to 13 additional hospitals in Victoria, New South Wales, Queensland, South Australia and Western Australia.
Study strengths and limitations
A strength of the study was that clinical staff could easily navigate the inclusion criteria and complete 99% of the baseline data. The difference in the number of messages sent between allocated groups demonstrated adherence to the trial protocol. Limitations included the variability in quality of goals set at baseline and challenges with the time required to assist participants to set person-centred goals. Additionally, the number of potentially eligible participants not approached was not well recorded; therefore, the true recruitment proportion remains unclear. Participants were recruited from only three metropolitan hospitals, so it is possible that findings may not be nationally generalisable. A potential limitation was that we did not conduct qualitative interviews with participants as part of the phase II evaluation to determine whether the discharge support package was person-centred. However, the qualitative feedback from development of the goal-setting package and the preliminary testing of the intervention [22, 36] indicated that the goal-setting menu provided an opportunity for the participant to reflect on what was important to them and the health professionals were supportive in guiding the process for developing their goals. Qualitative feedback from participants will be collected in the phase III testing of ReCAPS.
We successfully demonstrated feasibility of conducting a randomised controlled trial in the acute phase of stroke for participants to receive tailored support for ongoing recovery and secondary prevention post-stroke. Identified barriers to implementing the protocol were modifiable and have resulted in the establishment of a refined protocol. A phase III RCT is feasible and acceptable to clinicians and participants, and a sufficiently powered trial is further required to understand the clinical and cost-effectiveness of the ReCAPS digital health post-hospital discharge support package.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
The European Quality of Life questionnaire
Goal Attainment Scale
Hospital Anxiety and Depression Scale
Health Education Impact Questionnaire
Inspiring Virtual Enabled Resources following Vascular Events
Longer-term Unmet Needs Scale
Modified Rankin Scale
Randomised Controlled Trial
Recovery-focused Community support to Avoid readmissions and improve Participation after Stroke
Research Electronic Data Capture
- SMART Criteria/Goals:
Specific, Measurable, Achievable, Realistic and Time-bound
Smart Goal Evaluation Method
Short message service
Stroke Self-Efficacy Questionnaire
Feigin VL, Krishnamurthi RV, Parmar P, et al. Update on the global burden of ischemic and hemorrhagic stroke in 1990-2013: the GBD 2013 study. Neuroepidemiology. 2015;45:161–76. https://doi.org/10.1159/000441085.
National Stroke Foundation. Walk in our shoes. Stroke survivors and carers report on support after stroke. Melbourne: National Stroke Foundation; 2007.
Lennon O, Hall P, Blake C. Predictors of adherence to lifestyle recommendations in stroke secondary prevention. Int J Environ Res Public Health. 2021;18:4666. https://doi.org/10.3390/ijerph18094666.
Jones F, Riazi A. Self-efficacy and self-management after stroke: a systematic review. Disabil Rehabil. 2011;33:797–810. https://doi.org/10.3109/09638288.2010.511415.
Silva GS, Schwamm LH. Advances in Stroke: Digital Health. Stroke. 2020;52:351–5. https://doi.org/10.1161/STROKEAHA.120.033239.
Lloyd A, Bannigan K, Sugavanam T, et al. Experiences of stroke survivors, their families and unpaid carers in goal setting within stroke rehabilitation: a systematic review of qualitative evidence. JBI Database System Rev Implement Rep. 2018;16:1418–53. https://doi.org/10.11124/JBISRIR-2017-003499.
Hurn J, Kneebone I, Cropley M. Goal setting as an outcome measure: a systematic review. Clin Rehabil. 2006;20:756–72. https://doi.org/10.1177/0269215506070793.
Rosewilliam S, Roskell CA, Pandyan AD. A systematic review and synthesis of the quantitative and qualitative evidence behind patient-centred goal setting in stroke rehabilitation. Clin Rehabil. 2011;25:501–14. https://doi.org/10.1177/0269215510394467.
Australian Communications and Media Authority. Digital lives of older Australians. 2021.
Pollock A, St George B, Fenton M, et al. Top 10 research priorities relating to life after stroke – consensus from stroke survivors, caregivers, and health professionals. Int J Stroke. 2014;9:313–20. https://doi.org/10.1111/j.1747-4949.2012.00942.x.
Varnfield M, Karunanithi M, Lee C-K, et al. Smartphone-based home care model improved use of cardiac rehabilitation in postmyocardial infarction patients: results from a randomised controlled trial. Heart. 2014;100:1770–9. https://doi.org/10.1136/heartjnl-2014-305783.
Smith GC, Egbert N, Dellman-Jenkins M, et al. Reducing depression in stroke survivors and their informal caregivers: a randomized clinical trial of a Web-based intervention. Rehabil Psychol. 2012;57:196–206. https://doi.org/10.1037/a0029587.
Jin K, Khonsari S, Gallagher R, et al. Telehealth interventions for the secondary prevention of coronary heart disease: a systematic review and meta-analysis. Eur J Cardiovasc Nurs. 2019;18:260–71. https://doi.org/10.1177/1474515119826510.
Kamal AK, Shaikh Q, Pasha O, et al. A randomized controlled behavioral intervention trial to improve medication adherence in adult stroke patients with prescription tailored Short Messaging Service (SMS)-SMS4Stroke study. BMC Neurol. 2015;15:212. https://doi.org/10.1186/s12883-015-0471-5.
Wan LH, Zhang XP, You LM, et al. The efficacy of a comprehensive reminder system to improve health behaviors and blood pressure control in hypertensive ischemic stroke patients: a randomized controlled trial. J Cardiovasc Nurs. 2018;33:509–17. https://doi.org/10.1097/JCN.0000000000000496.
Zheng X, Spatz ES, Bai X, et al. Effect of text messaging on risk factor management in patients with coronary heart disease: The CHAT randomized clinical trial. Circ Cardiovasc Qual Outcomes. 2019;12:e005616. https://doi.org/10.1161/CIRCOUTCOMES.119.005616.
Chow CK, Redfern J, Hillis GS, et al. Effect of lifestyle-focused text messaging on risk factor modification in patients with coronary heart disease: a randomized clinical trial. JAMA. 2015;314:1255–63. https://doi.org/10.1001/jama.2015.10945.
Thabane L, Ma J, Chu R, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10:1. https://doi.org/10.1186/1471-2288-10-1.
van Swieten JC, Koudstaal PJ, Visser MC, et al. Interobserver agreement for the assessment of handicap in stroke patients. Stroke. 1988;19:604–7.
Harris PA, Taylor R, Thielke R, et al. Research electronic data capture (REDCap)--a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42:377–81. https://doi.org/10.1016/j.jbi.2008.08.010.
Cadilhac DA, Busingye D, Li JC, et al. Development of an electronic health message system to support recovery after stroke: Inspiring Virtual Enabled Resources following Vascular Events (iVERVE). Patient Prefer Adherence. 2018;12:1213–24. https://doi.org/10.2147/PPA.S154581.
Barnden R, Cadilhac DA, Lannin NA, et al. Development and field testing of a standardised goal setting package for person-centred discharge care planning in stroke. PEC Innovation. 2022;1:100008. https://doi.org/10.1016/j.pecinn.2021.100008.
Turner-Stokes L. Goal attainment scaling (GAS) in rehabilitation: a practical guide. Clin Rehabil. 2009;23:362–70. https://doi.org/10.1177/0269215508101742.
Turner-Stokes L, Baguley IJ, De Graaff S, et al. Goal attainment scaling in the evaluation of treatment of upper limb spasticity with botulinum toxin: a secondary analysis from a double-blind placebo-controlled randomized clinical trial. J Rehabil Med. 2010;42:81–9. https://doi.org/10.2340/16501977-0474.
Bowman J, Mogensen L, Marsland E, et al. The development, content validity and inter-rater reliability of the SMART-Goal Evaluation Method: a standardised method for evaluating clinical goals. Aust Occup Ther J. 2015;62:420–7. https://doi.org/10.1111/1440-1630.12218.
Osborne RH, Elsworth GR, Whitfield K. The Health Education Impact Questionnaire (heiQ): an outcomes and evaluation measure for patient education and self-management interventions for people with chronic conditions. Patient Educ Couns. 2007;66:192–201.
Jones F, Partridge C, Reid F. The Stroke Self-Efficacy Questionnaire: measuring individual confidence in functional performance after stroke. J Clin Nurs. 2008;17:244–52. https://doi.org/10.1111/j.1365-2702.2008.02333.x.
Zigmond AS, Snaith RP. The hospital anxiety and depression scale. Acta Psychiatr Scand. 1983;67:361–70.
Herdman M, Gudex C, Lloyd A, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20:1727–36. https://doi.org/10.1007/s11136-011-9903-x.
LoTS care LUNS study team. Validation of the longer-term unmet needs after stroke (LUNS) monitoring tool: a multicentre study. Clin Rehabil. 2013;27:1020–8. https://doi.org/10.1177/0269215513487082.
Cadilhac DA, Andrew NE, Busingye D, et al. Pilot randomised clinical trial of an ehealth, self-management support intervention (iVERVE) for stroke survivors: feasibility assessment 12-24-months post event. Pilot Feasibility Stud. 2020;6:172.
Stroke Foundation. Clinical Guidelines for Stroke Management 2021, https://informme.org.au/Guidelines/Clinical-Guidelines-for-Stroke-Management (Accessed 30 Dec 2021).
Julious SA. Sample size of 12 per group rule of thumb for a pilot study. Pharm Stat. 2005;4:287–91. https://doi.org/10.1002/pst.185.
O'Cathain A, Hoddinott P, Lewin S, et al. Maximising the impact of qualitative research in feasibility studies for randomised controlled trials: guidance for researchers. Pilot Feasibility Stud. 2015;1:32. https://doi.org/10.1186/s40814-015-0026-y.
Cadilhac DA, Cameron J, Kilkenny MF, et al. Protocol of a randomized controlled trial investigating the effectiveness of Recovery-focused Community support to Avoid readmissions and improve Participation after Stroke (ReCAPS). Int J Stroke. 2022;17:236–41. https://doi.org/10.1177/17474930211022678.
Purvis T, Busingye D, Andrew NE, et al. Mixed methods evaluation to explore participant experiences of a pilot randomized trial to facilitate self-management of people living with stroke: Inspiring virtual enabled resources following vascular events (iVERVE). Health Expect. 2022;25(5):2570–81. https://doi.org/10.1111/hex.13584.
ReCAPS Chief Investigators: Dominique Cadilhac (Monash University), Natasha Lannin (Monash University), Helen Dewey (Monash University), Monique Kilkenny (Monash University), Nadine Andrew (Monash University), Ian Kneebone (University of Technology Sydney), Avril Drummond (University of Nottingham), Jan Cameron (Monash University).
ReCAPS Co-Investigators: Amanda Thrift (Monash University); Maree Hackett (University New South Wales); Christopher Levi, Mariko Carey (University of Newcastle); Geoff Cloud, (Alfred Health); Rohan Grimley (Sunshine Coast University Hospital); Sandy Middleton (Australian Catholic University); Vincent Thijs (Austin hospital); Toni Aslett (Stroke Foundation); Jonathon Li (Monash University); Ernest Butler (Peninsula Health); Henry Ma (Monash Health).
Trial hospital recruitment site clinicians: Bronwyn Coulton (Monash Health); Kanaga Lagma, Marie Matanas, Rebecca Danton, Natasha Bonanno (Peninsula Health); Grace Thomas, Naila Pachini, Jennifer Liu (Eastern Health).
Statistics: Amanda Thrift (Monash University), Monique Kilkenny (Monash University).
Telecommunications engineer/technical lead iVERVE system: Jonathan Li (Monash University).
Goal scoring and quality assessments: Rebecca Barnden (Monash University), Amanda Elston (Monash University), Tara Purvis (Monash University).
Data Safety Monitoring Board: Graeme Hankey (chair, University of Western Australia) Leonid Churilov, Geoff Donnan (University of Melbourne), Coralie English (University of Newcastle).
ReCAPS Office: Garveeta Sookram (previously from Monash University), Lana Coleman (Monash University), Dawn Harris (previously from Monash University), Jan Cameron (Monash University).
ReCAPS Outcome Assessors (Monash University): Tharshanah Thayabaranathan, Verena Schadewaldt, Toni Withiel.
Project Consultant (Florey Institute): Fiona Ellery.
Consumer Advocacy: Toni Aslett (previously from the Stroke Foundation).
Consumer representatives: Eleanor Horton, Brenda Booth, Ida Dempsey.
The ReCAPS Phase II trial was funded by the Victorian Medical Research Acceleration Fund and Monash University (near-miss). The following authors received research fellowship support from the NHMRC (DAC: 1154273, MLH 1141328, MFK 1141848). NAL and MFK were supported by a Future Leader Fellowships (#102055 and #105737) from the National Heart Foundation of Australia.
Ethics approval and consent to participate
The study was approved by the following Human Research Ethics Committee: Monash Health (RES-18-0000-170A); Monash University (Project ID 16435); Peninsula Health (SSA/39945/PH-2019); Eastern Health (SERP93-2018); Austin Health (SSA/39945/Austin-2019-166787). All participants provided written informed consent before data collection began.
Consent for publication
All authors have consented to the publication of this research as presented in this manuscript.
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Cameron, J., Lannin, N.A., Harris, D. et al. A mixed-methods feasibility study of a new digital health support package for people after stroke: the Recovery-focused Community support to Avoid readmissions and improve Participation after Stroke (ReCAPS) intervention. Pilot Feasibility Stud 8, 241 (2022). https://doi.org/10.1186/s40814-022-01197-8
- Digital health
- Feasibility study
- Healthcare technology